Sep 28 16:55:23 devstack cinder-volume[75924]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:55:23 devstack cinder-volume[75924]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:55:23 devstack cinder-volume[75924]: we strongly recommend against using it for new projects. Sep 28 16:55:23 devstack cinder-volume[75924]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:55:23 devstack cinder-volume[75924]: framework. For more detail see Sep 28 16:55:23 devstack cinder-volume[75924]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:55:23 devstack cinder-volume[75924]: import eventlet # noqa Sep 28 16:55:26 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:55:26 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:55:26 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:55:27 devstack cinder-volume[75924]: INFO dbcounter [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Registered counter for database cinder Sep 28 16:55:27 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:27 devstack cinder-volume[75924]: DEBUG dbcounter [-] [75924] Writer thread running {{(pid=75924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:55:27 devstack cinder-volume[75924]: INFO cinder.rpc [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:55:27 devstack cinder-volume[75924]: INFO cinder.rpc [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:55:27 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:28 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Determined volume DB was empty at startup. Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG cinder.volume.manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75924) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:55:28 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:55:28 devstack cinder-volume[75924]: WARNING stevedore.named [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:55:28 devstack cinder-volume[75924]: WARNING castellan.key_manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:28 devstack cinder-volume[75924]: WARNING cinder.keymgr.conf_key_mgr [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG cinder.volume.drivers.lvm [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75924) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_concurrency.processutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_concurrency.processutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] CMD "cinder-rtstool verify" returned: 0 in 0.463s {{(pid=75924) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:28 devstack cinder-volume[75924]: INFO cinder.rpc [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 16:55:28 devstack cinder-volume[75924]: INFO cinder.rpc [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 16:55:28 devstack cinder-volume[75924]: WARNING stevedore.named [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:55:28 devstack cinder-volume[75924]: WARNING castellan.key_manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:55:28 devstack cinder-volume[75924]: INFO cinder.volume.manager [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_db.sqlalchemy.engines [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75924) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:28 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Starting 1 workers Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Started child 76075 {{(pid=75924) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Full set of CONF: {{(pid=75924) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] ******************************************************************************** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Configuration options gathered from: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] ================================================================================ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] allow_availability_zone_fallback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] allow_compression_on_image_upload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] allowed_direct_url_schemes = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] api_rate_limit = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] auth_strategy = keystone {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] az_cache_duration = 3600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[76075]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_host = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_stats_polling_interval = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backup_api_class = cinder.backup.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backup_name_template = backup-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backup_use_same_host = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backup_use_temp_snapshot = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] chap_username = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_internal_tenant_project_id = 6838d906d28b4846860f8d6ddbe573f5 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_internal_tenant_user_id = 31c37271b16c476b849b1f07a0d53541 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cloned_volume_same_az = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cluster = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] compression_format = gzip {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] compute_api_class = cinder.compute.nova.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] config_dir = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] config_source = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] control_exchange = openstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] debug = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] default_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] default_group_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] default_volume_type = lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_ssl_cert_verify = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] driver_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] enable_force_upload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] enable_new_services = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] enable_unsupported_driver = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] enabled_backends = ['lvmdriver-1'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] enforce_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_api_insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_api_ssl_compression = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_ca_certificates_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_catalog_info = image:glance:publicURL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_num_retries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance_request_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] graceful_shutdown_timeout = 5 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] group_api_class = cinder.group.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] host = devstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_compress_on_upload = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_conversion_address_space_limit = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_conversion_cpu_limit = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_conversion_disable = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_introspection_address_space_limit = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_introspection_cpu_limit = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_upload_use_cinder_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_upload_use_internal_tenant = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_volume_cache_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_volume_cache_max_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] image_volume_cache_max_size_gb = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] init_host_max_objects_retrieval = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] instance_format = [instance: %(uuid)s] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iscsi_target_flags = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iscsi_write_cache = on {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iser_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iser_ip_address = 192.168.122.253 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iser_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_color = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_config_append = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_options = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_rotate_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_rotate_interval_type = days {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] log_rotation_type = none {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] max_age = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] max_logfile_count = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] max_logfile_size_mb = 200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] max_over_subscription_ratio = 20.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] message_reap_interval = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] message_ttl = 2592000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] migration_create_volume_timeout_secs = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] monkey_patch = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] monkey_patch_modules = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] my_ip = 192.168.122.253 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] no_snapshot_gb_quota = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] num_iser_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] num_shell_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] num_volume_device_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] nvmeof_conn_info_version = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] nvmet_ns_id = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] nvmet_port_id = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_max_limit = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_ext_list = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_listen = 0.0.0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_listen_port = 8776 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] osapi_volume_workers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] per_volume_size_limit = -1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] periodic_fuzzy_delay = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] periodic_interval = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] project_id_regex = [0-9a-f\-]+ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] public_endpoint = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] publish_errors = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_backup_gigabytes = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_backups = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_gigabytes = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_groups = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_snapshots = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] quota_volumes = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] rate_limit_burst = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] rate_limit_except_level = CRITICAL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] rate_limit_interval = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] reinit_driver_count = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] report_discard_supported = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] report_interval = 120 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] reservation_clean_interval = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] reservation_expire = 86400 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] reserved_image_namespaces = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] reserved_percentage = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] rpc_response_timeout = 120 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] run_external_periodic_tasks = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] scst_target_driver = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_down_time = 720 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] shell_completion = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] snapshot_name_template = snapshot-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] snapshot_same_host = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] state_path = /opt/stack/data/cinder {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] storage_availability_zone = nova {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] storage_protocol = iSCSI {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] syslog_log_facility = LOG_USER {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_helper = lioadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_ip_address = 192.168.122.253 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] target_secondary_ip_addresses = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] transfer_api_class = cinder.transfer.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] transport_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] until_refresh = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_chap_auth = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_default_quota_class = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_journal = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_json = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_stderr = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] use_syslog = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] verify_glance_signatures = enabled {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_api_class = cinder.volume.api.API {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_clear_size = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_copy_bps_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_dd_blocksize = 1M {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_name_template = volume-%s {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_service_inithost_offload = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volume_usage_audit_period = month {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] zoning_mode = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_concurrency.disable_process_locking = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.auth_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.cache = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.delay_auth_decision = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.http_connect_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.include_service_catalog = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.interface = public {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcache_username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.service_token_roles_required = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.service_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.token_cache_time = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.backend = dogpile.cache.null {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.backend_argument = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.backend_expiration_time = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.config_prefix = cache.oslo {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.debug_cache_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.enable_retry_client = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.enable_socket_keepalive = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.expiration_time = 600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.hashclient_retry_attempts = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_dead_retry = 300 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_pool_maxsize = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_sasl_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.063s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.proxies = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.redis_db = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.redis_sentinel_service_name = mymaster {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.redis_server = localhost:6379 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.retry_attempts = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.retry_delay = 0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.socket_keepalive_count = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.socket_keepalive_idle = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.socket_keepalive_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.socket_timeout = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.tls_allowed_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.tls_cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.tls_certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.tls_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.tls_keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cache.username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] coordination.backend_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.asyncio_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.asyncio_slave_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.backend = sqlalchemy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.connection_debug = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.connection_parameters = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.connection_recycle_time = 3600 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.connection_trace = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.db_inc_retry_interval = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.db_max_retries = 20 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.db_max_retry_interval = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.db_retry_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.max_overflow = 50 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.max_pool_size = 5 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.max_retries = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.mysql_wsrep_sync_wait = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.pool_timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.retry_interval = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.slave_connection = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.sqlite_synchronous = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:28 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.synchronous_reader = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] database.use_db_reconnect = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_tracing.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.connection_string = messaging:// {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.es_doc_type = notification {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.es_scroll_size = 10000 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.es_scroll_time = 2m {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.filter_error_trace = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.hmac_keys = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.sentinel_service_name = mymaster {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.socket_timeout = 0.1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.trace_requests = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler.trace_sqlalchemy = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler_jaeger.process_tags = {} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler_jaeger.service_name_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] profiler_otlp.service_name_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.enforce_new_defaults = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.policy_default_rule = default {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.policy_file = policy.yaml {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_policy.remote_timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.group = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.helper_command = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] privsep_osbrick.user = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.group = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.helper_command = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] cinder_sys_admin.user = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.send_service_user_token = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] service_user.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.auth_type = password {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] glance.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.chap_username = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.driver_use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.enable_unsupported_driver = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.extra_capabilities = {} {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iscsi_target_flags = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iscsi_write_cache = on {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iser_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iser_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.lvm_mirrors = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.lvm_share_target = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.lvm_type = auto {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.num_shell_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.nvmet_port_id = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.report_discard_supported = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.reserved_percentage = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.scst_target_driver = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.storage_protocol = iSCSI {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_helper = tgtadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.unique_fqdn_network = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.use_chap_auth = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_backend_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_clear_size = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volume_group = cinder-volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_reports.file_event_handler = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_reports.log_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.backend_availability_zone = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.backend_host = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.chap_password = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.chap_username = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.chiscsi_conf = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.disk_geometry = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_client_cert = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_data_namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.driver_use_ssl = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.extra_capabilities = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.filter_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.goodness_function = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iser_helper = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iser_ip_address = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iser_port = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.iser_target_prefix = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.lvm_conf_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.lvm_mirrors = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.lvm_share_target = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.lvm_type = auto {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.num_shell_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.nvmet_port_id = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.replication_device = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.report_discard_supported = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.reserved_percentage = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.scst_target_driver = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.storage_protocol = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack sudo[76079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_helper = lioadm {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_ip_address = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_port = 3260 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_protocol = iscsi {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.trace_flags = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack sudo[76079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.use_chap_auth = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_clear = zero {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_clear_size = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] lvmdriver-1.volumes_dir = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.ssl_version = {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_notifications.driver = [] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_notifications.retry = -1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] oslo_messaging_notifications.transport_url = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] key_manager.fixed_key = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.barbican_api_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.barbican_endpoint = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.barbican_endpoint_type = public {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.barbican_region_name = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.number_of_retries = 60 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.retry_delay = 1 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.send_service_user_token = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.verify_ssl = True {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican.verify_ssl_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.auth_section = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.auth_type = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.cafile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.certfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.collect_timing = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.insecure = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.keyfile = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.split_loggers = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.timeout = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.tls_ciphers = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] barbican_service_user.tls_min_version = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.approle_role_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.approle_secret_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.auth_method = approle {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.auth_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.kv_mountpoint = secret {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.kv_path = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.kv_version = 2 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.namespace = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.root_token_id = **** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.ssl_ca_crt_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.timeout = 60.0 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.token_file = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.token_role = None {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.use_ssl = False {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:55:29 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] ******************************************************************************** {{(pid=75924) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:55:29 devstack sudo[76079]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.387s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:29 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:29 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:29 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.351s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:55:29 devstack cinder-volume[76075]: INFO cinder.brick.local_dev.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:29 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:29 devstack sudo[76184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:29 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:30 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG cinder.brick.local_dev.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76075) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:30 devstack sudo[76285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:30 devstack sudo[76285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:30 devstack sudo[76285]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.567s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:30 devstack sudo[76484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:30 devstack sudo[76484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:30 devstack sudo[76484]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.324s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:30 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:31 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 16:55:31 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:31 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.342s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:31 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:31 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:31 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:31 devstack sudo[76698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:31 devstack sudo[76698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:31 devstack sudo[76698]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:31 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:31 devstack sudo[76782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:31 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:32 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:32 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:32 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:32 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:32 devstack sudo[76809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:32 devstack sudo[76809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:32 devstack sudo[76809]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:32 devstack cinder-volume[76075]: INFO cinder.volume.drivers.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:32 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:32 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:32 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:33 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:33 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:33 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:33 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:33 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:33 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:33 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:33 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:33 devstack sudo[76888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:33 devstack sudo[76888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:34 devstack sudo[76888]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:34 devstack sudo[76891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:34 devstack sudo[76891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:34 devstack sudo[76891]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:34 devstack cinder-volume[76075]: INFO cinder.volume.driver [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG cinder.volume.driver [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76075) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writer thread running {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG cinder.db.api [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Building query based on filter {{(pid=76075) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG cinder.image.image_utils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76075) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:55:34 devstack cinder-volume[76075]: INFO cinder.keymgr.migration [None req-5ab3c2c5-08b3-45f3-a74e-386bf9dbca2f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:34 devstack sudo[76901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:34 devstack sudo[76901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:34 devstack sudo[76901]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:34 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:34 devstack sudo[76905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:34 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:35 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:35 devstack sudo[76910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:35 devstack sudo[76910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:35 devstack sudo[76910]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:35 devstack sudo[76913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:35 devstack sudo[76913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:35 devstack sudo[76913]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG cinder.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Notifying Schedulers of capabilities ... {{(pid=76075) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:55:35 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Driver initialization completed successfully. Sep 28 16:55:35 devstack cinder-volume[76075]: INFO cinder.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Initiating service 2 cleanup Sep 28 16:55:35 devstack cinder-volume[76075]: INFO cinder.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Service 2 cleanup completed. Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG cinder.service [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Creating RPC server for service cinder-volume {{(pid=76075) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG cinder.service [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76075) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:55:35 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:55:35 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:35 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:55:35 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:36 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:36 devstack sudo[76919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:36 devstack sudo[76919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:36 devstack sudo[76919]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.371s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:36 devstack sudo[76923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:55:36 devstack sudo[76923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:36 devstack sudo[76923]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:55:36 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:55:36 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:55:36 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Sep 28 16:55:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:55:37 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-6fb075d7-0d58-4de3-9da7-c006d3fad5be None None] Driver post RPC initialization completed successfully. Sep 28 16:55:38 devstack cinder-volume[75924]: DEBUG dbcounter [-] [75924] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75924) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:55:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:56:06 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager._thread_info {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:56:06 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread count: 6 {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:56:06 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread info: [<_MainThread(MainThread, started 134145368727680)>, , , , , ] {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:06 devstack sudo[80215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:57:06 devstack sudo[80215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:06 devstack sudo[80215]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:06 devstack sudo[80354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:06 devstack sudo[80354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:06 devstack sudo[80354]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:06 devstack sudo[80496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:57:06 devstack sudo[80496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:06 devstack sudo[80496]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:57:06 devstack sudo[80639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:57:06 devstack sudo[80639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:57:07 devstack sudo[80639]: pam_unix(sudo:session): session closed for user root Sep 28 16:57:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:57:07 devstack cinder-volume[76075]: DEBUG cinder.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Notifying Schedulers of capabilities ... {{(pid=76075) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:57:07 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager._thread_info {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:57:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread count: 6 {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:57:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread info: [<_MainThread(MainThread, started 134145368727680)>, , , , , ] {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:57:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:SELECT=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:57:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:UPDATE=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:06 devstack sudo[83185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:58:06 devstack sudo[83185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:06 devstack sudo[83185]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:06 devstack sudo[83188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:06 devstack sudo[83188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:06 devstack sudo[83188]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:06 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:58:06 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:06 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:58:06 devstack sudo[83198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:58:06 devstack sudo[83198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:58:07 devstack sudo[83198]: pam_unix(sudo:session): session closed for user root Sep 28 16:58:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:58:07 devstack cinder-volume[76075]: DEBUG cinder.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Notifying Schedulers of capabilities ... {{(pid=76075) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:58:07 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager._thread_info {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:58:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread count: 6 {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:58:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread info: [<_MainThread(MainThread, started 134145368727680)>, , , , , ] {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:06 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:59:06 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:06 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:06 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:06 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:06 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:06 devstack sudo[84729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:59:06 devstack sudo[84729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:06 devstack sudo[84729]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:59:06 devstack sudo[84732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:59:06 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:59:07 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root Sep 28 16:59:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:59:07 devstack cinder-volume[76075]: DEBUG cinder.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Notifying Schedulers of capabilities ... {{(pid=76075) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:59:07 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager._thread_info {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:59:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread count: 6 {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:59:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread info: [<_MainThread(MainThread, started 134145368727680)>, , , , , ] {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:59:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:SELECT=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:59:47 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:UPDATE=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Updating volume stats {{(pid=76075) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:06 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 17:00:06 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:06 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:06 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:06 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:06 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.382s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:06 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:06 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 17:00:06 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:07 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.329s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:07 devstack sudo[85810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 17:00:07 devstack sudo[85810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:07 devstack sudo[85810]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG cinder.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Notifying Schedulers of capabilities ... {{(pid=76075) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG oslo_service.periodic_task [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] Running periodic task VolumeManager._thread_info {{(pid=76075) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread count: 6 {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:00:07 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-eee6cd85-a6b6-4717-8ca7-51443392524c None None] thread info: [<_MainThread(MainThread, started 134145368727680)>, , , , , ] {{(pid=76075) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:00:11 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Caught SIGTERM, stopping children Sep 28 17:00:11 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Acquiring lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:11 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Acquired lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:11 devstack cinder-volume[75924]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Releasing lock "singleton_lock" {{(pid=75924) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:11 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Stop services. {{(pid=75924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:00:11 devstack cinder-volume[75924]: DEBUG oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Killing children. {{(pid=75924) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:00:11 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Waiting on 1 children to exit Sep 28 17:00:15 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Acquiring lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:15 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Acquired lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:15 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Releasing lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:15 devstack cinder-volume[76075]: WARNING amqp [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:15 devstack cinder-volume[76075]: WARNING amqp [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:15 devstack cinder-volume[75924]: INFO oslo_service.backend._eventlet.service [None req-054cf836-3cee-418f-9d14-6660fd1b37da None None] Child 76075 exited with status 0 Sep 28 17:00:16 devstack cinder-volume[86100]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:00:16 devstack cinder-volume[86100]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:00:16 devstack cinder-volume[86100]: we strongly recommend against using it for new projects. Sep 28 17:00:16 devstack cinder-volume[86100]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:00:16 devstack cinder-volume[86100]: framework. For more detail see Sep 28 17:00:16 devstack cinder-volume[86100]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:00:16 devstack cinder-volume[86100]: import eventlet # noqa Sep 28 17:00:18 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:18 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:18 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:19 devstack cinder-volume[86100]: INFO dbcounter [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Registered counter for database cinder Sep 28 17:00:19 devstack cinder-volume[86100]: DEBUG oslo_db.sqlalchemy.engines [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:19 devstack cinder-volume[86100]: DEBUG dbcounter [-] [86100] Writer thread running {{(pid=86100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:19 devstack cinder-volume[86100]: INFO cinder.rpc [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:19 devstack cinder-volume[86100]: INFO cinder.rpc [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_db.sqlalchemy.engines [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:20 devstack cinder-volume[86100]: INFO cinder.volume.manager [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Determined volume DB was empty at startup. Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG cinder.volume.manager [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86100) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:20 devstack cinder-volume[86100]: INFO cinder.volume.manager [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 17:00:20 devstack cinder-volume[86100]: WARNING stevedore.named [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:20 devstack cinder-volume[86100]: WARNING castellan.key_manager [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:20 devstack cinder-volume[86100]: WARNING cinder.keymgr.conf_key_mgr [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:20 devstack cinder-volume[86100]: INFO cinder.volume.manager [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_db.sqlalchemy.engines [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:20 devstack cinder-volume[86100]: INFO oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Starting 1 workers Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Started child 86366 {{(pid=86100) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Full set of CONF: {{(pid=86100) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] ******************************************************************************** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Configuration options gathered from: {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] ================================================================================ {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:20 devstack cinder-volume[86366]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] allow_availability_zone_fallback = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] allow_compression_on_image_upload = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] allowed_direct_url_schemes = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] api_rate_limit = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] auth_strategy = keystone {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_availability_zone = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_host = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_stats_polling_interval = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backup_api_class = cinder.backup.api.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backup_name_template = backup-%s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backup_use_same_host = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backup_use_temp_snapshot = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] chap_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] chap_username = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_internal_tenant_project_id = 6838d906d28b4846860f8d6ddbe573f5 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_internal_tenant_user_id = 31c37271b16c476b849b1f07a0d53541 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cluster = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] compression_format = gzip {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] compute_api_class = cinder.compute.nova.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] config_dir = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] config_source = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] control_exchange = openstack {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] debug = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] default_availability_zone = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] default_group_type = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] default_volume_type = QuobyteHD {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] disk_geometry = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_client_cert = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_client_cert_key = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_data_namespace = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_ssl_cert_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_ssl_cert_verify = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] driver_use_ssl = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] enable_new_services = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] enable_unsupported_driver = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] enabled_backends = ['QuobyteHD'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] enforce_multipath_for_image_xfer = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] filter_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_api_insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_api_ssl_compression = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_ca_certificates_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_catalog_info = image:glance:publicURL {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_num_retries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance_request_timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] goodness_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] graceful_shutdown_timeout = 5 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] group_api_class = cinder.group.api.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] host = devstack {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_compress_on_upload = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_conversion_address_space_limit = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_conversion_cpu_limit = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_conversion_disable = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_introspection_address_space_limit = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_introspection_cpu_limit = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_upload_use_cinder_backend = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_upload_use_internal_tenant = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_volume_cache_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_volume_cache_max_count = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] image_volume_cache_max_size_gb = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] init_host_max_objects_retrieval = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] instance_format = [instance: %(uuid)s] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iscsi_target_flags = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iscsi_write_cache = on {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iser_helper = tgtadm {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86366) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iser_ip_address = 192.168.122.253 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iser_port = 3260 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_color = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_config_append = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_dir = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_options = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_rotate_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_rotate_interval_type = days {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] log_rotation_type = none {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] max_age = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] max_logfile_count = 30 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] max_logfile_size_mb = 200 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] max_over_subscription_ratio = 20.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] message_reap_interval = 86400 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] message_ttl = 2592000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] migration_create_volume_timeout_secs = 300 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] monkey_patch = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] monkey_patch_modules = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] my_ip = 192.168.122.253 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] no_snapshot_gb_quota = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] num_iser_scan_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] num_shell_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] num_volume_device_scan_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] nvmeof_conn_info_version = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] nvmet_ns_id = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] nvmet_port_id = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_max_limit = 1000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_ext_list = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_listen_port = 8776 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_use_ssl = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] osapi_volume_workers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] per_volume_size_limit = -1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] periodic_fuzzy_delay = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] periodic_interval = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] public_endpoint = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] publish_errors = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_backup_gigabytes = 1000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_backups = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_gigabytes = 1000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_groups = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_snapshots = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] quota_volumes = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] rate_limit_burst = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] rate_limit_except_level = CRITICAL {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] rate_limit_interval = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] reinit_driver_count = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] replication_device = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] report_discard_supported = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] report_interval = 120 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] reservation_clean_interval = 86400 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] reservation_expire = 86400 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] reserved_image_namespaces = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] reserved_percentage = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] rpc_response_timeout = 120 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] run_external_periodic_tasks = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] scst_target_driver = iscsi {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] scst_target_iqn_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_down_time = 720 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] shell_completion = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] snapshot_name_template = snapshot-%s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] split_loggers = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] state_path = /opt/stack/data/cinder {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] storage_availability_zone = nova {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] storage_protocol = iSCSI {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] syslog_log_facility = LOG_USER {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_helper = lioadm {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_ip_address = 192.168.122.253 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_port = 3260 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_protocol = iscsi {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] target_secondary_ip_addresses = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] trace_flags = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] transport_url = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] until_refresh = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_chap_auth = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86366) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:00:20 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:00:20 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_default_quota_class = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_journal = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_json = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_multipath_for_image_xfer = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_stderr = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] use_syslog = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Running cmd (subprocess): mount.quobyte {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] verify_glance_signatures = enabled {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_api_class = cinder.volume.api.API {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_backend_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_clear = zero {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_clear_ionice = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_clear_size = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_copy_bps_limit = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_dd_blocksize = 1M {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_name_template = volume-%s {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_service_inithost_offload = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volume_usage_audit_period = month {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] zoning_mode = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_concurrency.disable_process_locking = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.auth_section = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.auth_type = password {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.auth_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.cache = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.include_service_catalog = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.interface = public {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcache_username = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.region_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.service_type = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.backend = dogpile.cache.null {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.backend_argument = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.backend_expiration_time = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.config_prefix = cache.oslo {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.debug_cache_backend = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.enable_retry_client = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.enable_socket_keepalive = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.expiration_time = 600 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.hashclient_retry_attempts = 2 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_dead_retry = 300 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_pool_maxsize = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_sasl_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.proxies = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack quobyte-client[86378]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:00:20 devstack quobyte-client[86378]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.redis_db = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.redis_server = localhost:6379 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.retry_attempts = 2 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.retry_delay = 0.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 ... Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.socket_keepalive_count = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.socket_keepalive_idle = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.socket_keepalive_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 -c /etc/quobyte/client-cinder.cfg {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.socket_timeout = 1.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.tls_allowed_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.tls_cafile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.tls_certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.tls_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.tls_keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cache.username = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] coordination.backend_url = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.asyncio_connection = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.asyncio_slave_connection = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.backend = sqlalchemy {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.connection = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.connection_debug = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.connection_parameters = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.connection_recycle_time = 3600 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.connection_trace = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.db_inc_retry_interval = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.db_max_retries = 20 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.db_max_retry_interval = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.db_retry_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.max_overflow = 50 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.max_pool_size = 5 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.max_retries = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.mysql_wsrep_sync_wait = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.pool_timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.retry_interval = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.slave_connection = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.sqlite_synchronous = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.synchronous_reader = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] database.use_db_reconnect = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_tracing.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.connection_string = messaging:// {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.es_doc_type = notification {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.es_scroll_size = 10000 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.es_scroll_time = 2m {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.filter_error_trace = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.hmac_keys = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 -c /etc/quobyte/client-cinder.cfg Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.sentinel_service_name = mymaster {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.socket_timeout = 0.1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.trace_requests = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler.trace_sqlalchemy = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler_jaeger.process_tags = {} {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler_jaeger.service_name_prefix = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] profiler_otlp.service_name_prefix = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.enforce_new_defaults = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.policy_default_rule = default {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.policy_file = policy.yaml {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.group = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.helper_command = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] privsep_osbrick.user = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.group = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.helper_command = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] cinder_sys_admin.user = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.auth_section = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.auth_type = password {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.cafile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.collect_timing = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.send_service_user_token = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.split_loggers = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.tls_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] service_user.tls_min_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.auth_section = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.auth_type = password {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.collect_timing = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.region_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.split_loggers = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.tls_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] glance.tls_min_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.backend_availability_zone = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.chap_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.chap_username = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.disk_geometry = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_client_cert = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_client_cert_key = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_data_namespace = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.driver_use_ssl = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.extra_capabilities = {} {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.filter_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.goodness_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iscsi_target_flags = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iscsi_write_cache = on {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iser_helper = tgtadm {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iser_port = 3260 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_host = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_login = admin {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_mount_options = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_private_key = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_share_path = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.num_shell_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.quobyte_volume_url = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.replication_device = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.report_discard_supported = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.reserved_percentage = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_helper = tgtadm {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_port = 3260 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_protocol = iscsi {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.trace_flags = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.unique_fqdn_network = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.use_chap_auth = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_backend_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_clear = zero {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_clear_ionice = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_clear_size = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_reports.file_event_handler = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_reports.log_dir = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.backend_availability_zone = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.backend_host = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.chap_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.chap_username = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.chiscsi_conf = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.disk_geometry = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_client_cert = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_data_namespace = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.driver_use_ssl = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.extra_capabilities = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.filter_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.goodness_function = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iser_helper = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iser_ip_address = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iser_port = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.iser_target_prefix = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_host = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_login = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_mount_options = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_password = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_private_key = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_share_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_ssh_port = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.num_shell_tries = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.nvmet_port_id = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.replication_device = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.report_discard_supported = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.reserved_percentage = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.scst_target_driver = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.storage_protocol = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_helper = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_ip_address = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_port = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_prefix = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_protocol = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.trace_flags = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.use_chap_auth = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_clear = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_clear_size = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] QuobyteHD.volumes_dir = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_notifications.driver = [] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_notifications.retry = -1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] key_manager.fixed_key = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.barbican_api_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.barbican_endpoint = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.barbican_endpoint_type = public {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.barbican_region_name = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.cafile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.collect_timing = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.number_of_retries = 60 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.retry_delay = 1 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.send_service_user_token = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.split_loggers = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.tls_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.tls_min_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.verify_ssl = True {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican.verify_ssl_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.auth_section = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.auth_type = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.cafile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.certfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.collect_timing = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.insecure = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.keyfile = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.split_loggers = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.timeout = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.tls_ciphers = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] barbican_service_user.tls_min_version = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.approle_role_id = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.approle_secret_id = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.auth_method = approle {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.auth_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.kv_mountpoint = secret {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.kv_path = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.kv_version = 2 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.namespace = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.root_token_id = **** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.ssl_ca_crt_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.timeout = 60.0 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.token_file = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.token_role = None {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.use_ssl = False {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:20 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] ******************************************************************************** {{(pid=86100) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:21 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.686s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[86366]: INFO cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 succeeded Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.702s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:21 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:21 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:21 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:21 devstack cinder-volume[86366]: INFO cinder.volume.driver [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.driver [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.153060913086, 'free_capacity_gb': 1775.153060913086, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86366) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG oslo_db.sqlalchemy.engines [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writer thread running {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:21 devstack cinder-volume[86366]: DEBUG cinder.db.api [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Building query based on filter {{(pid=86366) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86366) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:22 devstack cinder-volume[86366]: INFO cinder.keymgr.migration [None req-4f3058ec-0405-4bdf-b881-a727ae9ae02f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:22 devstack sudo[86526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:22 devstack sudo[86526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:22 devstack sudo[86526]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.541s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Driver initialization completed successfully. Sep 28 17:00:22 devstack cinder-volume[86366]: INFO cinder.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Initiating service 3 cleanup Sep 28 17:00:22 devstack cinder-volume[86366]: INFO cinder.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Service 3 cleanup completed. Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.service [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Creating RPC server for service cinder-volume {{(pid=86366) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.service [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86366) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:22 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:22 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:23 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.355s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-622c1f0d-90d8-486c-905f-1b953e9e3d73 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:26 devstack cinder-volume[86100]: INFO oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Caught SIGTERM, stopping children Sep 28 17:00:26 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Acquiring lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:26 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Acquired lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:26 devstack cinder-volume[86100]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Releasing lock "singleton_lock" {{(pid=86100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:26 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Stop services. {{(pid=86100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 17:00:26 devstack cinder-volume[86100]: DEBUG oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Killing children. {{(pid=86100) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 17:00:26 devstack cinder-volume[86100]: INFO oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Waiting on 1 children to exit Sep 28 17:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Acquiring lock "singleton_lock" {{(pid=86366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Acquired lock "singleton_lock" {{(pid=86366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Releasing lock "singleton_lock" {{(pid=86366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:27 devstack cinder-volume[86366]: WARNING amqp [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:27 devstack cinder-volume[86366]: WARNING amqp [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 17:00:27 devstack cinder-volume[86100]: INFO oslo_service.backend._eventlet.service [None req-c50e660c-f27f-4a67-a880-ec457367aa59 None None] Child 86366 exited with status 0 Sep 28 17:00:27 devstack cinder-volume[86770]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 17:00:27 devstack cinder-volume[86770]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:00:27 devstack cinder-volume[86770]: we strongly recommend against using it for new projects. Sep 28 17:00:27 devstack cinder-volume[86770]: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:00:27 devstack cinder-volume[86770]: framework. For more detail see Sep 28 17:00:27 devstack cinder-volume[86770]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:00:27 devstack cinder-volume[86770]: import eventlet # noqa Sep 28 17:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 17:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 17:00:29 devstack cinder-volume[86770]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86770) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 17:00:30 devstack cinder-volume[86770]: INFO dbcounter [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Registered counter for database cinder Sep 28 17:00:30 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:30 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writer thread running {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:30 devstack cinder-volume[86770]: INFO cinder.rpc [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 17:00:30 devstack cinder-volume[86770]: INFO cinder.rpc [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Determined volume DB was empty at startup. Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG cinder.volume.manager [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86770) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 17:00:31 devstack cinder-volume[86770]: WARNING stevedore.named [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 17:00:31 devstack cinder-volume[86770]: WARNING castellan.key_manager [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:31 devstack cinder-volume[86770]: WARNING cinder.keymgr.conf_key_mgr [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 17:00:31 devstack cinder-volume[86770]: INFO cinder.volume.manager [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_db.sqlalchemy.engines [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86770) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:31 devstack cinder-volume[86770]: INFO oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Starting 1 workers Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Started child 86842 {{(pid=86770) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Full set of CONF: {{(pid=86770) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] Configuration options gathered from: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] ================================================================================ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] allow_availability_zone_fallback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86842]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] allow_compression_on_image_upload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] allowed_direct_url_schemes = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] api_rate_limit = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] auth_strategy = keystone {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_stats_polling_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backup_api_class = cinder.backup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backup_name_template = backup-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backup_use_same_host = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_internal_tenant_project_id = 6838d906d28b4846860f8d6ddbe573f5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_internal_tenant_user_id = 31c37271b16c476b849b1f07a0d53541 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cluster = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] compression_format = gzip {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] compute_api_class = cinder.compute.nova.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] config_dir = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] config_source = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] control_exchange = openstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] debug = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] default_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] default_group_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] default_volume_type = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] enable_new_services = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] enabled_backends = ['QuobyteHD'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_api_insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_api_servers = ['http://192.168.122.253/image'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_api_ssl_compression = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_ca_certificates_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_catalog_info = image:glance:publicURL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_num_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance_request_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] graceful_shutdown_timeout = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] group_api_class = cinder.group.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] host = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_compress_on_upload = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_conversion_address_space_limit = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_conversion_cpu_limit = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_conversion_disable = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_introspection_address_space_limit = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_introspection_cpu_limit = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] init_host_max_objects_retrieval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] instance_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iser_ip_address = 192.168.122.253 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_color = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_config_append = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_options = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_rotate_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_rotate_interval_type = days {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] log_rotation_type = none {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] max_age = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] max_logfile_count = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] max_logfile_size_mb = 200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] message_reap_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] message_ttl = 2592000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] migration_create_volume_timeout_secs = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] monkey_patch = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] monkey_patch_modules = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] my_ip = 192.168.122.253 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] no_snapshot_gb_quota = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86842) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_max_limit = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_ext_list = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_listen_port = 8776 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] osapi_volume_workers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] per_volume_size_limit = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] periodic_fuzzy_delay = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] periodic_interval = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] public_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] publish_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_backup_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_backups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_gigabytes = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_groups = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_snapshots = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] quota_volumes = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] rate_limit_burst = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] rate_limit_except_level = CRITICAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] rate_limit_interval = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] reinit_driver_count = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] report_interval = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] reservation_clean_interval = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] reservation_expire = 86400 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] reserved_image_namespaces = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] rpc_response_timeout = 120 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] run_external_periodic_tasks = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_down_time = 720 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] shell_completion = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] snapshot_name_template = snapshot-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] state_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] storage_availability_zone = nova {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] syslog_log_facility = LOG_USER {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_helper = lioadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_ip_address = 192.168.122.253 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] until_refresh = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_default_quota_class = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_journal = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_json = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_stderr = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] use_syslog = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] verify_glance_signatures = enabled {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_api_class = cinder.volume.api.API {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_name_template = volume-%s {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_service_inithost_offload = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volume_usage_audit_period = month {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] zoning_mode = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_concurrency.disable_process_locking = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.auth_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.include_service_catalog = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.interface = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcache_username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.service_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.253/identity {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.backend = dogpile.cache.null {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86842) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 17:00:31 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 17:00:31 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.backend_argument = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.backend_expiration_time = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Running cmd (subprocess): mount.quobyte {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.config_prefix = cache.oslo {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.debug_cache_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.enable_retry_client = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.enable_socket_keepalive = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.expiration_time = 600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.hashclient_retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_dead_retry = 300 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_pool_maxsize = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_sasl_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.proxies = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.redis_db = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.redis_server = localhost:6379 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.retry_attempts = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.retry_delay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.socket_keepalive_count = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.socket_keepalive_idle = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.socket_keepalive_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.socket_timeout = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.tls_allowed_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.tls_cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.tls_certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.tls_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.tls_keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cache.username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] coordination.backend_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.asyncio_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.asyncio_slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.backend = sqlalchemy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.connection_debug = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.connection_parameters = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.connection_recycle_time = 3600 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.connection_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.db_inc_retry_interval = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.db_max_retries = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.db_max_retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.db_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.max_overflow = 50 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.max_pool_size = 5 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.max_retries = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.mysql_wsrep_sync_wait = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.pool_timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.retry_interval = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.slave_connection = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.sqlite_synchronous = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.synchronous_reader = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] database.use_db_reconnect = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_tracing.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.connection_string = messaging:// {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.es_doc_type = notification {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.es_scroll_size = 10000 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.es_scroll_time = 2m {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.filter_error_trace = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.hmac_keys = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.sentinel_service_name = mymaster {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.socket_timeout = 0.1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.trace_requests = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler.trace_sqlalchemy = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler_jaeger.process_tags = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler_jaeger.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] profiler_otlp.service_name_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.enforce_new_defaults = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.policy_default_rule = default {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.policy_file = policy.yaml {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] privsep_osbrick.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.group = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.helper_command = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] cinder_sys_admin.user = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.send_service_user_token = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] service_user.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.auth_type = password {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack quobyte-client[86844]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] glance.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack quobyte-client[86844]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.chap_username = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.driver_use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.extra_capabilities = {} {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iscsi_target_flags = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iscsi_write_cache = on {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iser_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iser_ip_address = 192.168.122.253 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iser_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_host = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_login = admin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_private_key = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_share_path = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.num_shell_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.quobyte_volume_url = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.report_discard_supported = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.reserved_percentage = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_helper = tgtadm {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_ip_address = 192.168.122.253 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_port = 3260 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_protocol = iscsi {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.unique_fqdn_network = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.use_chap_auth = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_backend_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_clear = zero {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_clear_size = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_reports.file_event_handler = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_reports.log_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.backend_availability_zone = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.backend_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.chap_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.chap_username = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.chiscsi_conf = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.disk_geometry = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_client_cert = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_data_namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.driver_use_ssl = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.extra_capabilities = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.filter_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.goodness_function = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack sudo[86845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iser_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iser_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iser_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.iser_target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_host = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_login = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_mount_options = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_password = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_private_key = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_share_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_ssh_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.num_shell_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.nvmet_port_id = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.replication_device = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.report_discard_supported = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.reserved_percentage = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.scst_target_driver = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.storage_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_helper = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_ip_address = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_port = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_prefix = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_protocol = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.trace_flags = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.use_chap_auth = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_clear = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_clear_size = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] QuobyteHD.volumes_dir = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_notifications.driver = [] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_notifications.retry = -1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] key_manager.fixed_key = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.barbican_api_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.barbican_endpoint = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.barbican_endpoint_type = public {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.barbican_region_name = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.number_of_retries = 60 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.retry_delay = 1 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.send_service_user_token = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.verify_ssl = True {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican.verify_ssl_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.auth_section = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.auth_type = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.cafile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.certfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.collect_timing = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.insecure = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.keyfile = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.split_loggers = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.timeout = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.tls_ciphers = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] barbican_service_user.tls_min_version = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.approle_role_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.approle_secret_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.auth_method = approle {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.auth_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.kv_mountpoint = secret {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.kv_path = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.kv_version = 2 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.namespace = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.root_token_id = **** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.ssl_ca_crt_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.timeout = 60.0 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.token_file = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.token_role = None {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.use_ssl = False {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 17:00:31 devstack cinder-volume[86770]: DEBUG oslo_service.backend._eventlet.service [None req-3b838fe8-4ed4-4b2b-b3a4-5798732a4b00 None None] ******************************************************************************** {{(pid=86770) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 17:00:31 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:31 devstack cinder-volume[86842]: INFO cinder.volume.driver [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.driver [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1520614624023, 'free_capacity_gb': 1775.1520614624023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86842) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_db.sqlalchemy.engines [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86842) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writer thread running {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.db.api [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Building query based on filter {{(pid=86842) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86842) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:31 devstack cinder-volume[86842]: INFO cinder.keymgr.migration [None req-22f05ce3-24bf-4b30-98c8-6198d7d38d41 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 17:00:31 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:31 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:32 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:00:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Driver initialization completed successfully. Sep 28 17:00:32 devstack cinder-volume[86842]: INFO cinder.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Initiating service 3 cleanup Sep 28 17:00:32 devstack cinder-volume[86842]: INFO cinder.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Service 3 cleanup completed. Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG cinder.service [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Creating RPC server for service cinder-volume {{(pid=86842) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG cinder.service [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86842) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 17:00:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:00:32 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:00:32 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:00:32 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Sep 28 17:00:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:00:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-642c2902-180e-4a2d-86a5-8b8ccba1c3c1 None None] Driver post RPC initialization completed successfully. Sep 28 17:00:41 devstack cinder-volume[86770]: DEBUG dbcounter [-] [86770] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86770) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=3 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:00:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:00:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 6 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:00:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:01:44 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:01:44 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:01:44 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.255s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 6 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:01:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (f5029bb5-fb8d-447d-8075-54528e42e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c5d24-8c8f-4271-b32f-7626ce078980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1c5d24-8c8f-4271-b32f-7626ce078980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975329756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce070d35-e0c0-4375-a1d6-d5ba7298e077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:17Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a51f6d-ba7e-4c70-aea5-2762c5c24e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a51f6d-ba7e-4c70-aea5-2762c5c24e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e6f38-6729-4fb5-a26e-b65b895aedb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959e6f38-6729-4fb5-a26e-b65b895aedb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce070d35-e0c0-4375-a1d6-d5ba7298e077', 'volume_name': 'volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea8169-17f7-4b75-9d71-6f7728c702ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ea8169-17f7-4b75-9d71-6f7728c702ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f92bff-2e35-434f-af9b-763569b84419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Volume ce070d35-e0c0-4375-a1d6-d5ba7298e077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077', 'volume_size': 1} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-975329756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce070d35-e0c0-4375-a1d6-d5ba7298e077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:17Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Creating volume ce070d35-e0c0-4375-a1d6-d5ba7298e077 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:16 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:02:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:16 devstack sudo[87323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 1073741824 Sep 28 17:02:16 devstack sudo[87323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:17 devstack sudo[87323]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 1073741824" returned: 0 in 0.715s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:17 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 Sep 28 17:02:17 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:17 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077" returned: 0 in 0.296s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f92bff-2e35-434f-af9b-763569b84419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d1420-67e3-4290-bfe0-c0cd3f68c5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Volume volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 (ce070d35-e0c0-4375-a1d6-d5ba7298e077): created successfully Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071d1420-67e3-4290-bfe0-c0cd3f68c5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (f5029bb5-fb8d-447d-8075-54528e42e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f50e3c26-92c0-437c-8666-3c769999fb64 tempest-VolumesTestJSON-1712406304 None] Created volume successfully. Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (f866d82e-8efd-4046-ac91-f47f46f6d438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07aa2ff-16a9-4f7f-bd66-ddb4045c31b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07aa2ff-16a9-4f7f-bd66-ddb4045c31b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-505050757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac899a0-4f03-4a58-9d34-a783e5f03494,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:20Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d597a7-c306-484d-bb56-3e4dda13d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d597a7-c306-484d-bb56-3e4dda13d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bae13b-f9af-4e69-a406-94f469d86d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98bae13b-f9af-4e69-a406-94f469d86d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac899a0-4f03-4a58-9d34-a783e5f03494', 'volume_name': 'volume-3ac899a0-4f03-4a58-9d34-a783e5f03494', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5d7218-6af9-4f24-83e6-70d8da8fe7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5d7218-6af9-4f24-83e6-70d8da8fe7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977e50e1-f70a-4bf4-aa3e-82da500866dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Volume 3ac899a0-4f03-4a58-9d34-a783e5f03494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac899a0-4f03-4a58-9d34-a783e5f03494', 'volume_size': 1} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-505050757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac899a0-4f03-4a58-9d34-a783e5f03494,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:20Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Creating volume 3ac899a0-4f03-4a58-9d34-a783e5f03494 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:19 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:02:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:19 devstack sudo[87646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 1073741824 Sep 28 17:02:19 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:20 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 1073741824" returned: 0 in 0.589s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:20 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 Sep 28 17:02:20 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:20 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494" returned: 0 in 0.293s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (977e50e1-f70a-4bf4-aa3e-82da500866dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac899a0-4f03-4a58-9d34-a783e5f03494', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68957aa2-a4f0-4c3d-9e62-231ac1af9315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Volume volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 (3ac899a0-4f03-4a58-9d34-a783e5f03494): created successfully Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68957aa2-a4f0-4c3d-9e62-231ac1af9315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (f866d82e-8efd-4046-ac91-f47f46f6d438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d34acb0e-b914-4b8b-8ddc-f64ddf5c24a8 tempest-VolumesTestJSON-1712406304 None] Created volume successfully. Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (51a95c96-04a1-484d-bc49-c4835980c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1259e8-c3cc-40b6-addb-74895d7bb8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1259e8-c3cc-40b6-addb-74895d7bb8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115320735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf323aa-41b7-47e8-b7e2-aae4e5ca6188,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:23Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0d417a-a685-40cf-ac3b-ee7a67ecdd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b0d417a-a685-40cf-ac3b-ee7a67ecdd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421c650f-a5c9-4bdb-ba2e-a7d377dbedf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421c650f-a5c9-4bdb-ba2e-a7d377dbedf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf323aa-41b7-47e8-b7e2-aae4e5ca6188', 'volume_name': 'volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da8b5a-84ed-480c-bdbf-abfff375d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13da8b5a-84ed-480c-bdbf-abfff375d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d36298-f369-46c7-aa83-52290e509400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Volume abf323aa-41b7-47e8-b7e2-aae4e5ca6188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188', 'volume_size': 1} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115320735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf323aa-41b7-47e8-b7e2-aae4e5ca6188,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab5ba339afa5421d8dbd0363ec5efe7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:23Z,use_quota=True,user_id='c1710361b70c49a89177d0ede3cc843c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Creating volume abf323aa-41b7-47e8-b7e2-aae4e5ca6188 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:23 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:02:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:23 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 1073741824 Sep 28 17:02:23 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:24 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 1073741824" returned: 0 in 0.740s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:24 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 Sep 28 17:02:24 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:24 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" returned: 0 in 0.323s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d36298-f369-46c7-aa83-52290e509400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80acb613-2187-4112-a71c-0cd51d311fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:24 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Volume volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 (abf323aa-41b7-47e8-b7e2-aae4e5ca6188): created successfully Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80acb613-2187-4112-a71c-0cd51d311fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Flow 'volume_create_manager' (51a95c96-04a1-484d-bc49-c4835980c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:24 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c81bf04b-6521-44d6-b3b6-7a3231045341 tempest-VolumesTestJSON-1712406304 None] Created volume successfully. Sep 28 17:02:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-abf323aa-41b7-47e8-b7e2-aae4e5ca6188-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "cinder-abf323aa-41b7-47e8-b7e2-aae4e5ca6188-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-quobyte-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:26 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmplfg_pz0y/privsep.sock'] Sep 28 17:02:26 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmplfg_pz0y/privsep.sock Sep 28 17:02:26 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 17:02:27 devstack cinder-volume[86842]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 17:02:27 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:27 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Spawned new privsep daemon via rootwrap Sep 28 17:02:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Accepted privsep connection to /tmp/tmplfg_pz0y/privsep.sock {{(pid=86842) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 17:02:27 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 17:02:27 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 17:02:27 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 17:02:27 devstack cinder-volume[86842]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87680 Sep 28 17:02:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec43ee6e-0313-4a4f-90e2-b695a3102b5f]: (2,) {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0775def9-8aeb-4999-a670-e8ac8ffff3b3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:28 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 Sep 28 17:02:28 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:28 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" returned: 0 in 0.433s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:28 devstack sudo[87687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188 Sep 28 17:02:28 devstack sudo[87687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:28 devstack sudo[87687]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-abf323aa-41b7-47e8-b7e2-aae4e5ca6188" released by "delete_volume" :: held 2.268s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:28 devstack cinder-volume[86842]: WARNING cinder.quota [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:28 devstack cinder-volume[86842]: WARNING cinder.quota [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:28 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Created reservations ['97d7c154-8a5c-4332-8d09-9af7b57bc614', 'b17f1101-6cac-44c7-9fc9-5034b7ef0015', '4765ea76-1d61-4c3b-8800-9a982811ab3f', '0fe94672-8a8c-4075-8e4c-4df20f739116'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:29 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:02:29 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:29 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.319s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Deleted volume successfully. Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-efa8ec73-ce46-453d-b06e-5a49a5fc1427 tempest-VolumesTestJSON-1712406304 None] Lock "cinder-abf323aa-41b7-47e8-b7e2-aae4e5ca6188-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-3ac899a0-4f03-4a58-9d34-a783e5f03494-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "cinder-3ac899a0-4f03-4a58-9d34-a783e5f03494-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-quobyte-3ac899a0-4f03-4a58-9d34-a783e5f03494" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-3ac899a0-4f03-4a58-9d34-a783e5f03494" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[94caebb5-c53e-495c-9624-49eecdc9f47b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:30 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 Sep 28 17:02:30 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:30 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494" returned: 0 in 0.573s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:30 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494 Sep 28 17:02:30 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:30 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3ac899a0-4f03-4a58-9d34-a783e5f03494" returned: 0 in 0.366s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-3ac899a0-4f03-4a58-9d34-a783e5f03494" released by "delete_volume" :: held 1.006s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Created reservations ['50d002bd-5a2b-465d-9ca6-45f3a15a6863', '87ca7985-8aff-45e0-b5b8-36e09e81f526', 'b455b68d-6804-47a8-aae5-17a6d821e797', 'd2c0d19f-ad6f-46f0-b46b-8cd430ca6bcb'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:31 devstack sudo[87704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:02:31 devstack sudo[87704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:31 devstack sudo[87704]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Deleted volume successfully. Sep 28 17:02:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d343dfd8-87c2-4c97-8cfa-8ebae6e511cb tempest-VolumesTestJSON-1712406304 None] Lock "cinder-3ac899a0-4f03-4a58-9d34-a783e5f03494-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-ce070d35-e0c0-4375-a1d6-d5ba7298e077-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "cinder-ce070d35-e0c0-4375-a1d6-d5ba7298e077-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Acquiring lock "cinder-quobyte-ce070d35-e0c0-4375-a1d6-d5ba7298e077" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-ce070d35-e0c0-4375-a1d6-d5ba7298e077" acquired by "delete_volume" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3b791a-10d0-432d-afc5-f4ebfccb8d02]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:32 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 Sep 28 17:02:32 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:32 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077" returned: 0 in 0.508s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:32 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077 Sep 28 17:02:32 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:33 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ce070d35-e0c0-4375-a1d6-d5ba7298e077" returned: 0 in 0.369s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "cinder-quobyte-ce070d35-e0c0-4375-a1d6-d5ba7298e077" released by "delete_volume" :: held 0.935s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Created reservations ['b6524f0e-1756-40fc-bb8a-6dbdc8d3906b', 'd9bc8a29-be1d-4f96-9bb6-396044ca303d', '3e454600-b4c1-4cd0-be5e-6c0faac7c8ef', 'c61cb5ae-dda2-4c12-9a00-4926041b6cb7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:33 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:02:33 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:33 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.289s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Deleted volume successfully. Sep 28 17:02:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f012a04a-3827-4ca3-a0a4-e0a05778832c tempest-VolumesTestJSON-1712406304 None] Lock "cinder-ce070d35-e0c0-4375-a1d6-d5ba7298e077-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:43 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:43 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=40,cinder:SELECT=20,cinder:DELETE=5,cinder:INSERT=7 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:44 devstack sudo[87728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:02:44 devstack sudo[87728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:44 devstack sudo[87728]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:02:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1311a054-9f5a-4d76-936d-196f5971a0bd tempest-GroupSnapshotsV319Test-203905132 None] Group tempest-GroupSnapshotsV319Test-Group-1887925551: creating Sep 28 17:02:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1311a054-9f5a-4d76-936d-196f5971a0bd tempest-GroupSnapshotsV319Test-203905132 None] Group tempest-GroupSnapshotsV319Test-Group-1887925551: created successfully Sep 28 17:02:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1311a054-9f5a-4d76-936d-196f5971a0bd tempest-GroupSnapshotsV319Test-203905132 None] Create group completed successfully. Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Flow 'volume_create_manager' (f6681ce6-e08d-4327-ba82-b4669636f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eccc66e-00d7-4f7d-a357-05361bd25923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eccc66e-00d7-4f7d-a357-05361bd25923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202927036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee804fe-7a7a-4cdb-a0e4-d71addb06836,host='devstack@QuobyteHD#QuobyteHD',id=10c762c1-5008-468e-9770-40efee1dd185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c1b9f6dee402d8a1e15e7bce4f55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:48Z,use_quota=True,user_id='f702952850f64683b4bd406df78328bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(348ada5f-7a26-47f1-9787-95922b9d3091),volume_type_id=348ada5f-7a26-47f1-9787-95922b9d3091)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc4482d-9f41-4e8a-8de9-3f8ffd897ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc4482d-9f41-4e8a-8de9-3f8ffd897ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4337c711-a0e0-42c0-a87b-1bd3cb698385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4337c711-a0e0-42c0-a87b-1bd3cb698385) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10c762c1-5008-468e-9770-40efee1dd185', 'volume_name': 'volume-10c762c1-5008-468e-9770-40efee1dd185', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3c0c88-60ed-485f-83d0-2816d7d6d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3c0c88-60ed-485f-83d0-2816d7d6d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413bf826-19d8-4392-b231-b2f95e4da1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:48 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Volume 10c762c1-5008-468e-9770-40efee1dd185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10c762c1-5008-468e-9770-40efee1dd185', 'volume_size': 1} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9ee804fe-7a7a-4cdb-a0e4-d71addb06836,created_at=2026-09-28T15:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1202927036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9ee804fe-7a7a-4cdb-a0e4-d71addb06836,host='devstack@QuobyteHD#QuobyteHD',id=10c762c1-5008-468e-9770-40efee1dd185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471c1b9f6dee402d8a1e15e7bce4f55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:02:48Z,use_quota=True,user_id='f702952850f64683b4bd406df78328bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(348ada5f-7a26-47f1-9787-95922b9d3091),volume_type_id=348ada5f-7a26-47f1-9787-95922b9d3091)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Creating volume 10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:02:48 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:02:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:48 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 1073741824 Sep 28 17:02:48 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:49 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 1073741824" returned: 0 in 0.709s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:49 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 Sep 28 17:02:49 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:49 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185" returned: 0 in 0.311s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (413bf826-19d8-4392-b231-b2f95e4da1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10c762c1-5008-468e-9770-40efee1dd185', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916dc8b4-0337-4174-a2e1-44ff9b1216b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:02:49 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Volume volume-10c762c1-5008-468e-9770-40efee1dd185 (10c762c1-5008-468e-9770-40efee1dd185): created successfully Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916dc8b4-0337-4174-a2e1-44ff9b1216b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:02:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Flow 'volume_create_manager' (f6681ce6-e08d-4327-ba82-b4669636f117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:02:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0605b5a3-5ef5-4417-9b74-c2fd274b0864 tempest-GroupSnapshotsV319Test-203905132 None] Created volume successfully. Sep 28 17:02:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] GroupSnapshot cf7bf207-17d0-429e-9504-809dd290b48d: creating. Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Group snapshot cf7bf207-17d0-429e-9504-809dd290b48d: creating. {{(pid=86842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Creating offline snapshot 0d6de20e-1088-4580-af9e-38818faf01e5 of volume 10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f8d71-145d-4ae5-8c5f-2924fa492249]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:51 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 Sep 28 17:02:51 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:52 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185" returned: 0 in 0.559s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:52 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 1G Sep 28 17:02:52 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:52 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 1G" returned: 0 in 0.656s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c762c1-5008-468e-9770-40efee1dd185 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:52 devstack sudo[87794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c762c1-5008-468e-9770-40efee1dd185 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 Sep 28 17:02:52 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:53 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10c762c1-5008-468e-9770-40efee1dd185 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:53 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:02:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:53 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 Sep 28 17:02:53 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:53 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:53 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info Sep 28 17:02:53 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:54 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info" returned: 0 in 0.348s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:54 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:02:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:54 devstack sudo[87807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info Sep 28 17:02:54 devstack sudo[87807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:54 devstack sudo[87807]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.info" returned: 0 in 0.376s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.038s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:02:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5950ef5f-e7ae-4451-a311-1384f4793d94 tempest-GroupSnapshotsV319Test-203905132 None] group_snapshot cf7bf207-17d0-429e-9504-809dd290b48d: created successfully Sep 28 17:02:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] group_snapshot cf7bf207-17d0-429e-9504-809dd290b48d: deleting Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] group_snapshot cf7bf207-17d0-429e-9504-809dd290b48d: deleting {{(pid=86842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "cinder-quobyte-0d6de20e-1088-4580-af9e-38818faf01e5" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-0d6de20e-1088-4580-af9e-38818faf01e5" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Deleting offline snapshot 0d6de20e-1088-4580-af9e-38818faf01e5 of volume 10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] snapshot_file for this snap is: volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7157441-7308-4ba6-b7de-4c799140881d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:55 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 Sep 28 17:02:55 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:56 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5" returned: 0 in 0.456s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10c762c1-5008-468e-9770-40efee1dd185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e15d7-37ce-4969-80ae-aea7693f65a1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:56 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 Sep 28 17:02:56 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:56 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185" returned: 0 in 0.433s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:56 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 Sep 28 17:02:56 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:57 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5" returned: 0 in 0.479s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:57 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5 Sep 28 17:02:57 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:57 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185.0d6de20e-1088-4580-af9e-38818faf01e5" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-0d6de20e-1088-4580-af9e-38818faf01e5" released by "_delete_snapshot" :: held 1.843s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" released by "delete_snapshot" :: held 1.902s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:57 devstack cinder-volume[86842]: WARNING cinder.quota [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-982039214 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-982039214, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:57 devstack cinder-volume[86842]: WARNING cinder.quota [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-982039214 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-982039214, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:57 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] Created reservations ['e3559cd3-e012-49a1-b2a8-401415664785', 'c539dbb3-8f56-47b7-8688-b85caef28da4', 'cc196ef1-b704-49af-8e7e-1f1ae6443159', '2fba5c2c-0e6d-4165-ba5e-8a537d3f196d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a2994159-71e9-4e80-83dc-f518e4e3a276 tempest-GroupSnapshotsV319Test-203905132 None] group_snapshot cf7bf207-17d0-429e-9504-809dd290b48d: deleted successfully Sep 28 17:02:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:02:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:02:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[affaac4d-2734-4545-9b83-81ae82b282d1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:02:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:58 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 Sep 28 17:02:58 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:59 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185" returned: 0 in 0.647s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:02:59 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185 Sep 28 17:02:59 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:02:59 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-10c762c1-5008-468e-9770-40efee1dd185" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Lock "cinder-quobyte-10c762c1-5008-468e-9770-40efee1dd185" released by "delete_volume" :: held 1.119s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Created reservations ['f688a2fe-8c6d-4193-a33f-994b578eeeda'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:02:59 devstack cinder-volume[86842]: WARNING cinder.quota [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-982039214 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-982039214, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:02:59 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Created reservations ['8df4f7bf-ddea-4fb1-8a6c-97d5252c3d36', 'ff49e7f2-b7d4-4967-910e-269cf39e8dcf', 'c75570f4-009d-4446-97d1-84ed990f24d3', '3d3e3a83-a842-4406-ae6a-4f0b6bcd3b3c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:00 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:03:00 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:00 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.497s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:00 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-98d2487c-f7f2-4f13-bbc4-547ea2ca65d5 tempest-GroupSnapshotsV319Test-203905132 None] Delete group completed successfully. Sep 28 17:03:10 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:10 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3dddfe5c-105d-4933-acc8-4b7131666f64 tempest-GroupsV314Test-1076106835 None] Group tempest-GroupsV314Test-Group-1171050935: creating Sep 28 17:03:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3dddfe5c-105d-4933-acc8-4b7131666f64 tempest-GroupsV314Test-1076106835 None] Group tempest-GroupsV314Test-Group-1171050935: created successfully Sep 28 17:03:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3dddfe5c-105d-4933-acc8-4b7131666f64 tempest-GroupsV314Test-1076106835 None] Create group completed successfully. Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Flow 'volume_create_manager' (1df3ab33-040e-4737-a7a4-c34b7c552470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70220b15-3cd9-4e48-ac7c-fa088974bff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70220b15-3cd9-4e48-ac7c-fa088974bff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-450355069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9c3a4e-aeba-41ca-b778-272ee8c7504f,host='devstack@QuobyteHD#QuobyteHD',id=8f445853-a9dd-40f0-b8f7-fcf431fef1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae0aceab46048818180e79a3666b69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:33Z,use_quota=True,user_id='16327bbeaa8d424fa55d28035928f6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00d7be02-eaba-45bb-9485-ff618900ab90),volume_type_id=00d7be02-eaba-45bb-9485-ff618900ab90)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef064bb2-93f8-48b4-996d-f167f9c37bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef064bb2-93f8-48b4-996d-f167f9c37bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6606b07b-e41e-4a00-9032-8b9020dd91ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6606b07b-e41e-4a00-9032-8b9020dd91ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f445853-a9dd-40f0-b8f7-fcf431fef1e5', 'volume_name': 'volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c2db99-2571-462c-af02-2a645ed2bbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c2db99-2571-462c-af02-2a645ed2bbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e78917c-da55-419f-b08c-67a652553e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Volume 8f445853-a9dd-40f0-b8f7-fcf431fef1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5', 'volume_size': 1} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0e9c3a4e-aeba-41ca-b778-272ee8c7504f,created_at=2026-09-28T15:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-450355069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0e9c3a4e-aeba-41ca-b778-272ee8c7504f,host='devstack@QuobyteHD#QuobyteHD',id=8f445853-a9dd-40f0-b8f7-fcf431fef1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae0aceab46048818180e79a3666b69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:33Z,use_quota=True,user_id='16327bbeaa8d424fa55d28035928f6ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00d7be02-eaba-45bb-9485-ff618900ab90),volume_type_id=00d7be02-eaba-45bb-9485-ff618900ab90)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Creating volume 8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:03:33 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:03:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:33 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 1073741824 Sep 28 17:03:33 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:34 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 1073741824" returned: 0 in 1.198s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:34 devstack sudo[88210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:03:34 devstack sudo[88210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:35 devstack sudo[88210]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 0.349s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.643s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e78917c-da55-419f-b08c-67a652553e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bb75be-f44e-4eb9-8581-30512eefed08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Volume volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 (8f445853-a9dd-40f0-b8f7-fcf431fef1e5): created successfully Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bb75be-f44e-4eb9-8581-30512eefed08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Flow 'volume_create_manager' (1df3ab33-040e-4737-a7a4-c34b7c552470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-da658b3e-3943-4313-aebf-22241b311274 tempest-GroupsV314Test-1076106835 None] Created volume successfully. Sep 28 17:03:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:37 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Cloning volume 8f445853-a9dd-40f0-b8f7-fcf431fef1e5 to volume b1838cd1-830e-4c7c-aaf2-03e2e00c686b Sep 28 17:03:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Creating offline snapshot ff766aa9-3e08-4b34-9f37-20f51548767e of volume 8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:03:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd6e18b-e866-4621-9bd8-766696d2138b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:38 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:03:38 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:39 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 1.050s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:39 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e 1G Sep 28 17:03:39 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:40 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e 1G" returned: 0 in 1.149s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:40 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:03:40 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:41 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.937s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:41 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:03:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:41 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:03:41 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:41 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.447s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:41 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info Sep 28 17:03:41 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:42 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info" returned: 0 in 0.546s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:42 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:42 devstack sudo[88356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info Sep 28 17:03:42 devstack sudo[88356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:42 devstack sudo[88356]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.info" returned: 0 in 0.513s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Acquiring lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] snapshot: ff766aa9-3e08-4b34-9f37-20f51548767e, volume: b1838cd1-830e-4c7c-aaf2-03e2e00c686b, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b32ce0-5a13-415e-ad16-f64337523142]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:43 devstack sudo[88373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:03:43 devstack sudo[88373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:43 devstack sudo[88373]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.882s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:03:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[341a12c2-50c4-46f2-b296-f52356f18282]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:44 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:03:44 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:44 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 0.631s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:44 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b Sep 28 17:03:44 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:03:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:44 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:03:44 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:45 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.526s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:03:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:03:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 8 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:03:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:03:51 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:51 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Flow 'volume_create_manager' (54ee77e7-258d-4233-b916-a7a48bbd49c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce92f22-2835-4829-b3be-354416a7d7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce92f22-2835-4829-b3be-354416a7d7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-624194792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56a8067-91c0-4248-a15a-30f44751e6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7cb0ac9539484fb4f942f4d1ff1f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:57Z,use_quota=True,user_id='9819d67003bb4d44997eedcbfbd5531a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ac80b5-d50d-4810-8c98-34a3ecd480b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ac80b5-d50d-4810-8c98-34a3ecd480b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008b3756-da57-41a2-82a6-f9f650b507fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008b3756-da57-41a2-82a6-f9f650b507fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56a8067-91c0-4248-a15a-30f44751e6cf', 'volume_name': 'volume-b56a8067-91c0-4248-a15a-30f44751e6cf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a4dee2-d298-4580-8aa2-1a6d434b8d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a4dee2-d298-4580-8aa2-1a6d434b8d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:03:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59c8161-962a-4ee3-b6d5-d6a025efdc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:03:57 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Volume b56a8067-91c0-4248-a15a-30f44751e6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56a8067-91c0-4248-a15a-30f44751e6cf', 'volume_size': 1} Sep 28 17:03:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:03:58 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" returned: 0 in 14.002s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5, size 1024.00 MB, duration 14.01 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:03:58 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Converted 1024.00 MB image at 73.11 MB/s Sep 28 17:03:58 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:58 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b Sep 28 17:03:58 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:58 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" released by "_copy_volume_from_snapshot" :: held 16.040s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Acquiring lock "cinder-quobyte-ff766aa9-3e08-4b34-9f37-20f51548767e" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-ff766aa9-3e08-4b34-9f37-20f51548767e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Deleting offline snapshot ff766aa9-3e08-4b34-9f37-20f51548767e of volume 8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] snapshot_file for this snap is: volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea89545-1475-4ae7-84cb-46cb2d6acded]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:59 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:03:59 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:03:59 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Sep 28 17:03:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.452s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:03:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:03:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0418a1-813e-44f0-8205-0f09b34dfe5c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:03:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:03:59 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:03:59 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:00 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 0.910s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:00 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:04:00 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:00 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.639s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:01 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e Sep 28 17:04:01 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Flow 'volume_create_manager' (f71e6f42-f426-4f8f-918b-fed9d708fe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6478848-dbfb-4392-b82f-d44be2421fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6478848-dbfb-4392-b82f-d44be2421fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2139821352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada7b8fa-032c-4f1d-997d-3d10c8e86702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc06fd8f736499698c3173600edcda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:01Z,use_quota=True,user_id='ba1bde6f84ad4c9d9f731967b055f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8ddfb7-a23e-42db-86e7-58f749a6272c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8ddfb7-a23e-42db-86e7-58f749a6272c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b763f05-4afe-4bab-a0d9-0d682f7e033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b763f05-4afe-4bab-a0d9-0d682f7e033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ada7b8fa-032c-4f1d-997d-3d10c8e86702', 'volume_name': 'volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b745ccc-e6ff-4e76-9471-c4929e265961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b745ccc-e6ff-4e76-9471-c4929e265961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0479f609-db85-45fc-87fc-6bc0c3432822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Volume ada7b8fa-032c-4f1d-997d-3d10c8e86702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702', 'volume_size': 1} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:01 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5.ff766aa9-3e08-4b34-9f37-20f51548767e" returned: 0 in 0.487s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-ff766aa9-3e08-4b34-9f37-20f51548767e" released by "_delete_snapshot" :: held 2.638s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.762s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.531s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-624194792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56a8067-91c0-4248-a15a-30f44751e6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7cb0ac9539484fb4f942f4d1ff1f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:03:57Z,use_quota=True,user_id='9819d67003bb4d44997eedcbfbd5531a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Creating volume b56a8067-91c0-4248-a15a-30f44751e6cf {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:04:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:01 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf 1073741824 Sep 28 17:04:01 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-91d0c150-c55e-4fcf-b881-e42237f68133 tempest-GroupsV314Test-1076106835 None] Create group from source-group-0e9c3a4e-aeba-41ca-b778-272ee8c7504f completed successfully. Sep 28 17:04:02 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf 1073741824" returned: 0 in 0.806s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:02 devstack sudo[88540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf Sep 28 17:04:02 devstack sudo[88540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Acquiring lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[586d10cf-a4b4-42a3-a9be-e4f12ef05eda]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:02 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b Sep 28 17:04:02 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:02 devstack sudo[88540]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2139821352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ada7b8fa-032c-4f1d-997d-3d10c8e86702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc06fd8f736499698c3173600edcda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:01Z,use_quota=True,user_id='ba1bde6f84ad4c9d9f731967b055f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Creating volume ada7b8fa-032c-4f1d-997d-3d10c8e86702 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:02 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59c8161-962a-4ee3-b6d5-d6a025efdc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56a8067-91c0-4248-a15a-30f44751e6cf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:02 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 1073741824 Sep 28 17:04:02 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87dd2a6-1923-4561-857e-019b9edb6a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Volume volume-b56a8067-91c0-4248-a15a-30f44751e6cf (b56a8067-91c0-4248-a15a-30f44751e6cf): created successfully Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e87dd2a6-1923-4561-857e-019b9edb6a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Flow 'volume_create_manager' (54ee77e7-258d-4233-b916-a7a48bbd49c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8f1a1c01-e1ab-49ed-9fd1-552e3eba463b tempest-VolumesAdminNegativeTest-1492273198 None] Created volume successfully. Sep 28 17:04:03 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" returned: 0 in 0.581s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:03 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b Sep 28 17:04:03 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:03 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" returned: 0 in 0.379s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:03 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 1073741824" returned: 0 in 0.765s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-b1838cd1-830e-4c7c-aaf2-03e2e00c686b" released by "delete_volume" :: held 1.031s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:03 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 Sep 28 17:04:03 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Created reservations ['729321f7-d215-4f42-b4fb-d13724213cc8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:03 devstack cinder-volume[86842]: WARNING cinder.quota [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1804478049 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1804478049, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:04:03 devstack cinder-volume[86842]: WARNING cinder.quota [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1804478049 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1804478049, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:04:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Created reservations ['325a589f-a883-4844-8c9b-5e1d853a80aa', 'ebdb6d84-8e6b-44ae-828a-d1e38161ec44', '2b4c6766-0f2f-44ae-9944-a7cda7614482', 'c7d519c9-7e66-462b-bcd8-df5290873418'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:04 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:04 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Acquiring lock "cinder-b56a8067-91c0-4248-a15a-30f44751e6cf-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "cinder-b56a8067-91c0-4248-a15a-30f44751e6cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:04 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Acquiring lock "cinder-quobyte-b56a8067-91c0-4248-a15a-30f44751e6cf" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702" returned: 0 in 0.491s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0479f609-db85-45fc-87fc-6bc0c3432822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd88a77-1cc3-425e-8c99-9e1c4da91551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "cinder-quobyte-b56a8067-91c0-4248-a15a-30f44751e6cf" acquired by "delete_volume" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Volume volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 (ada7b8fa-032c-4f1d-997d-3d10c8e86702): created successfully Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cd88a77-1cc3-425e-8c99-9e1c4da91551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Flow 'volume_create_manager' (f71e6f42-f426-4f8f-918b-fed9d708fe15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[369dedee-be44-454e-96c7-5164e7c125bb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-910bcfe9-29a8-4f07-a73f-366aa548a893 tempest-ServersNegativeTestJSON-108398892 None] Created volume successfully. Sep 28 17:04:04 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.387s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fd07a2e6-6388-419e-87f7-e045f7e2366a tempest-GroupsV314Test-1076106835 None] Delete group completed successfully. Sep 28 17:04:04 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf Sep 28 17:04:04 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:04 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf" returned: 0 in 0.439s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:04 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf Sep 28 17:04:04 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:05 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b56a8067-91c0-4248-a15a-30f44751e6cf" returned: 0 in 0.298s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "cinder-quobyte-b56a8067-91c0-4248-a15a-30f44751e6cf" released by "delete_volume" :: held 0.814s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Created reservations ['b11ae6ce-38a3-4685-8e6f-6293052662fd', '939f1108-9161-4f94-9df7-909f571d34aa', 'a2940984-754b-4d28-863c-a9c61a5c3edf', 'e15c59e1-3137-429a-8225-dc7e3f6a4cd7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:05 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:05 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Acquiring lock "cinder-quobyte-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:05 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.498s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Deleted volume successfully. Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34d8dd-78e7-4a41-b1de-03909f39c068]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2fc218d-d622-4d76-afde-2800d2b4ac77 tempest-VolumesAdminNegativeTest-1492273198 None] Lock "cinder-b56a8067-91c0-4248-a15a-30f44751e6cf-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:06 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:04:06 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:06 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 0.691s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:06 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5 Sep 28 17:04:06 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:06 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Lock "cinder-quobyte-8f445853-a9dd-40f0-b8f7-fcf431fef1e5" released by "delete_volume" :: held 1.277s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Created reservations ['8f47ed83-4ad7-46a4-8183-3d3a09f04eb1'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Created reservations ['b75eddc9-e685-46db-ae3c-ae39538a21f6', 'a1cf0777-6fb9-4cfd-9f80-c5c421a5abec', '00a7c9a1-9507-4319-9bb2-d0b8e1551dff', '7a812605-dd18-442c-8cb6-569bc02a4561'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:07 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:07 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:07 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.403s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:07 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-03bb49ab-0d91-4145-8655-d0447678faeb tempest-GroupsV314Test-1076106835 None] Delete group completed successfully. Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Flow 'volume_create_manager' (9bff57a8-3859-47b8-9319-59b14e94b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9563ad-dd42-45b9-abc3-eb11d19573c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a9563ad-dd42-45b9-abc3-eb11d19573c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-648752466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d2449a-4cc0-443c-83d3-5a8a3213b82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc06fd8f736499698c3173600edcda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:08Z,use_quota=True,user_id='ba1bde6f84ad4c9d9f731967b055f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b66a64-4639-4fc0-a722-304e761be7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b66a64-4639-4fc0-a722-304e761be7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5191c4c-bbac-4763-a58f-2f04b924220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5191c4c-bbac-4763-a58f-2f04b924220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d2449a-4cc0-443c-83d3-5a8a3213b82e', 'volume_name': 'volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a726bba5-f4a9-4561-b8d4-9d8ffde4afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a726bba5-f4a9-4561-b8d4-9d8ffde4afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7890ef-f109-4e0c-908d-5f30f876afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Volume a3d2449a-4cc0-443c-83d3-5a8a3213b82e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e', 'volume_size': 1} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-648752466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d2449a-4cc0-443c-83d3-5a8a3213b82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dc06fd8f736499698c3173600edcda8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:04:08Z,use_quota=True,user_id='ba1bde6f84ad4c9d9f731967b055f731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Creating volume a3d2449a-4cc0-443c-83d3-5a8a3213b82e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:04:08 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:04:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:08 devstack sudo[88617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e 1073741824 Sep 28 17:04:08 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:09 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e 1073741824" returned: 0 in 0.766s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:09 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e Sep 28 17:04:09 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:09 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" returned: 0 in 0.426s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c7890ef-f109-4e0c-908d-5f30f876afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3a6acb-cfdd-4772-b2cf-4307fa727466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:04:09 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Volume volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e (a3d2449a-4cc0-443c-83d3-5a8a3213b82e): created successfully Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3a6acb-cfdd-4772-b2cf-4307fa727466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:04:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Flow 'volume_create_manager' (9bff57a8-3859-47b8-9319-59b14e94b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:04:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-83d4df1c-f7c0-4525-b42c-acdb8e5862dd tempest-ServersNegativeTestJSON-108398892 None] Created volume successfully. Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "cinder-a3d2449a-4cc0-443c-83d3-5a8a3213b82e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-a3d2449a-4cc0-443c-83d3-5a8a3213b82e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "cinder-quobyte-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-quobyte-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e9af9-ca38-4c89-8d98-724eedd09160]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:15 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e Sep 28 17:04:15 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:15 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" returned: 0 in 0.534s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:15 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e Sep 28 17:04:15 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:15 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" returned: 0 in 0.324s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-quobyte-a3d2449a-4cc0-443c-83d3-5a8a3213b82e" released by "delete_volume" :: held 0.926s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:15 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Created reservations ['1955f5fd-1ce2-4c5d-9fb3-3faaf89197ea', '4cb13136-7955-4a4c-af40-221f8c690c73', 'c61e853e-7f36-499a-ae81-bd842cb598cd', '2a3c30cc-476f-45be-ad92-bb73c855049a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:16 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:16 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:16 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.370s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Deleted volume successfully. Sep 28 17:04:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8487c109-a701-46ef-8989-482bad3a6c9c tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-a3d2449a-4cc0-443c-83d3-5a8a3213b82e-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "cinder-ada7b8fa-032c-4f1d-997d-3d10c8e86702-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-ada7b8fa-032c-4f1d-997d-3d10c8e86702-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "cinder-quobyte-ada7b8fa-032c-4f1d-997d-3d10c8e86702" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-quobyte-ada7b8fa-032c-4f1d-997d-3d10c8e86702" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fd0b2-3e99-44ba-9056-847e1db159b3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:17 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 Sep 28 17:04:17 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:17 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:17 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702 Sep 28 17:04:17 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:18 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ada7b8fa-032c-4f1d-997d-3d10c8e86702" returned: 0 in 0.530s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-quobyte-ada7b8fa-032c-4f1d-997d-3d10c8e86702" released by "delete_volume" :: held 1.157s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Created reservations ['757b8af9-1399-4800-92ab-80f1d3bc4ac5', '26c18088-12e9-4654-8d03-bc5e5a59b9a6', '4a0567cc-6100-4626-a9b4-b82382107dfe', 'af7b1c70-c140-4572-9a2b-4505313d8763'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:18 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:18 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:19 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.438s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:19 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Deleted volume successfully. Sep 28 17:04:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-18f040c5-d44e-46a9-af8d-d80aec8d0cf1 tempest-ServersNegativeTestJSON-108398892 None] Lock "cinder-ada7b8fa-032c-4f1d-997d-3d10c8e86702-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:04:28 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=42,cinder:UPDATE=60,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=55,cinder:SELECT=36,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:04:44 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:04:44 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:04:44 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 8 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:04:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:16 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Flow 'volume_create_manager' (7572e47d-96fb-40f0-8654-ecf04559cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c4a6b4-2635-4ca2-a393-65438319e9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c4a6b4-2635-4ca2-a393-65438319e9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1666495555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45acb778-a19c-4a5b-a758-ac389d61a1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c6bd87526491e9c3f1b51ff260e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:17Z,use_quota=True,user_id='21f90cd386084a86a545fed50ce760b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b49496db-40ae-4714-a75b-9f41c127461d),volume_type_id=b49496db-40ae-4714-a75b-9f41c127461d)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1678642f-31d9-4ddb-b5e5-68be07577a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1678642f-31d9-4ddb-b5e5-68be07577a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f6bad5-c6c1-408b-b54e-565a4fcb550c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f6bad5-c6c1-408b-b54e-565a4fcb550c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45acb778-a19c-4a5b-a758-ac389d61a1d2', 'volume_name': 'volume-45acb778-a19c-4a5b-a758-ac389d61a1d2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5551a6f5-823b-432f-a64e-cd608c8c79c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5551a6f5-823b-432f-a64e-cd608c8c79c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4b866-d9e4-4b7d-a65a-29d293d1049b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Volume 45acb778-a19c-4a5b-a758-ac389d61a1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45acb778-a19c-4a5b-a758-ac389d61a1d2', 'volume_size': 1} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1666495555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45acb778-a19c-4a5b-a758-ac389d61a1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34c6bd87526491e9c3f1b51ff260e9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:17Z,use_quota=True,user_id='21f90cd386084a86a545fed50ce760b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b49496db-40ae-4714-a75b-9f41c127461d),volume_type_id=b49496db-40ae-4714-a75b-9f41c127461d)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Creating volume 45acb778-a19c-4a5b-a758-ac389d61a1d2 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:17 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:05:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:17 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 1073741824 Sep 28 17:05:17 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:18 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 1073741824" returned: 0 in 1.271s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Flow 'volume_create_manager' (b8cee29c-df05-42f4-8295-b13ccf938668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c8139e-7d99-4909-9d3c-4a58776e67ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34c8139e-7d99-4909-9d3c-4a58776e67ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1616847677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07818e2d-cb13-4e50-b34c-634d2751d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c864ad65fee147ecbc6c6cb4915a1318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:18Z,use_quota=True,user_id='b114ce23a18a40a99a121773d0772a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff7acdd-8e64-4f68-a69d-c0dae6e96325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff7acdd-8e64-4f68-a69d-c0dae6e96325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c29771-7d49-4b01-8587-3336adccaadf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c29771-7d49-4b01-8587-3336adccaadf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07818e2d-cb13-4e50-b34c-634d2751d626', 'volume_name': 'volume-07818e2d-cb13-4e50-b34c-634d2751d626', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48330375-a142-4e9f-8e8a-541a41e3f5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48330375-a142-4e9f-8e8a-541a41e3f5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a051a0-68f9-4c86-a6e3-2f86fbc94785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Volume 07818e2d-cb13-4e50-b34c-634d2751d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07818e2d-cb13-4e50-b34c-634d2751d626', 'volume_size': 1} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:18 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 Sep 28 17:05:18 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:19 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2" returned: 0 in 0.458s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1616847677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07818e2d-cb13-4e50-b34c-634d2751d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c864ad65fee147ecbc6c6cb4915a1318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:18Z,use_quota=True,user_id='b114ce23a18a40a99a121773d0772a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Creating volume 07818e2d-cb13-4e50-b34c-634d2751d626 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:19 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:19 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 1073741824 Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f4b866-d9e4-4b7d-a65a-29d293d1049b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45acb778-a19c-4a5b-a758-ac389d61a1d2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:19 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5883ba34-cc17-4491-bf7e-f71722d47dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Volume volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 (45acb778-a19c-4a5b-a758-ac389d61a1d2): created successfully Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5883ba34-cc17-4491-bf7e-f71722d47dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Flow 'volume_create_manager' (7572e47d-96fb-40f0-8654-ecf04559cf29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-50869d72-6995-4e46-8198-cd40c611dc9a tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Created volume successfully. Sep 28 17:05:20 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 1073741824" returned: 0 in 1.201s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:20 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 Sep 28 17:05:20 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:20 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626" returned: 0 in 0.342s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a051a0-68f9-4c86-a6e3-2f86fbc94785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07818e2d-cb13-4e50-b34c-634d2751d626', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:21 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:05:21 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc388662-e066-4cb5-b40c-444d12940257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:21 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Volume volume-07818e2d-cb13-4e50-b34c-634d2751d626 (07818e2d-cb13-4e50-b34c-634d2751d626): created successfully Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc388662-e066-4cb5-b40c-444d12940257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Flow 'volume_create_manager' (b8cee29c-df05-42f4-8295-b13ccf938668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-461c561e-a1e8-4fbc-9da7-e7a336334287 tempest-DeleteServersTestJSON-1473674818 None] Created volume successfully. Sep 28 17:05:21 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.517s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:21 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f90b5341-ec38-45d6-aab9-4e8e869a350c tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Retype volume completed successfully. Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "cinder-45acb778-a19c-4a5b-a758-ac389d61a1d2-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "cinder-45acb778-a19c-4a5b-a758-ac389d61a1d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "cinder-quobyte-45acb778-a19c-4a5b-a758-ac389d61a1d2" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "cinder-quobyte-45acb778-a19c-4a5b-a758-ac389d61a1d2" acquired by "delete_volume" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[77408376-71f6-4cb8-b43a-8799cce1c4bd]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:22 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 Sep 28 17:05:22 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:23 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2" returned: 0 in 0.610s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:23 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2 Sep 28 17:05:23 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:23 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45acb778-a19c-4a5b-a758-ac389d61a1d2" returned: 0 in 0.678s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "cinder-quobyte-45acb778-a19c-4a5b-a758-ac389d61a1d2" released by "delete_volume" :: held 1.407s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:23 devstack cinder-volume[86842]: WARNING cinder.quota [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:23 devstack cinder-volume[86842]: WARNING cinder.quota [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:05:23 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Created reservations ['eaf0e64b-3954-4626-bbd7-16a3c34911b4', 'a9dde994-4a24-4002-9829-9051621032a8', 'bd82a145-576f-4b84-992e-fa0769cce83f', '562c8329-d6ca-4fb5-8d59-1951a45bc7ad'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:24 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:05:24 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:24 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.390s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:24 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Deleted volume successfully. Sep 28 17:05:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27ff5b50-ee35-46b6-a5f7-bce5ad4524e1 tempest-VolumeRetypeWithoutMigrationTest-1966333437 None] Lock "cinder-45acb778-a19c-4a5b-a758-ac389d61a1d2-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Flow 'volume_create_manager' (486d3d43-0152-4010-8b22-a276cb2969e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a86507-fd99-4815-a702-34d1beee3d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a86507-fd99-4815-a702-34d1beee3d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1983117461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931abb83-8dec-4f80-8c98-1a9f23bc4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c8e3ec94c5492a96e678071c52159b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:26Z,use_quota=True,user_id='ec64040e081446a7aee5f98cecaeda2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3301d686-9a8f-4364-8c50-d94a0d6084b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3301d686-9a8f-4364-8c50-d94a0d6084b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f1eb8-9c3a-4e7b-9811-00a662b10e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b50f1eb8-9c3a-4e7b-9811-00a662b10e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931abb83-8dec-4f80-8c98-1a9f23bc4596', 'volume_name': 'volume-931abb83-8dec-4f80-8c98-1a9f23bc4596', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb0da09-ffce-45bf-9c24-af27db37a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb0da09-ffce-45bf-9c24-af27db37a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98555732-52fe-496b-8cdb-d36d8272d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Volume 931abb83-8dec-4f80-8c98-1a9f23bc4596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931abb83-8dec-4f80-8c98-1a9f23bc4596', 'volume_size': 1} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1983117461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931abb83-8dec-4f80-8c98-1a9f23bc4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c8e3ec94c5492a96e678071c52159b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:26Z,use_quota=True,user_id='ec64040e081446a7aee5f98cecaeda2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Creating volume 931abb83-8dec-4f80-8c98-1a9f23bc4596 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:26 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:05:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:26 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 1073741824 Sep 28 17:05:26 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:27 devstack cinder-volume[86842]: WARNING py.warnings [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 17:05:27 devstack cinder-volume[86842]: .first() Sep 28 17:05:27 devstack cinder-volume[86842]: Sep 28 17:05:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:27 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 1073741824" returned: 0 in 0.959s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:27 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 Sep 28 17:05:27 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:28 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596" returned: 0 in 0.555s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.033s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98555732-52fe-496b-8cdb-d36d8272d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931abb83-8dec-4f80-8c98-1a9f23bc4596', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e319f124-e447-4b99-9b5a-2aa794ccd6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:28 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Volume volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 (931abb83-8dec-4f80-8c98-1a9f23bc4596): created successfully Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e319f124-e447-4b99-9b5a-2aa794ccd6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Flow 'volume_create_manager' (486d3d43-0152-4010-8b22-a276cb2969e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-094790cb-3c83-4be9-b0ec-c2f51a52e6a8 tempest-ServerActionsTestOtherA-963292488 None] Created volume successfully. Sep 28 17:05:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-07818e2d-cb13-4e50-b34c-634d2751d626', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03374195-71b0-4897-9e2e-9d1b00cea65b', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:05:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-074b015f-70fb-413a-8366-9ea7ec869562 req-a7cc6f9f-dada-42d5-af34-3b493367fca5 tempest-DeleteServersTestJSON-1473674818 None] attachment_update completed successfully. Sep 28 17:05:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-9314ed6c-a860-459a-9c0d-1c39ca779281 req-2492d49d-3abe-4c94-9755-b1bf0eab2b96 tempest-DeleteServersTestJSON-1473674818 None] Terminate volume connection completed successfully. Sep 28 17:05:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-9314ed6c-a860-459a-9c0d-1c39ca779281 req-2492d49d-3abe-4c94-9755-b1bf0eab2b96 tempest-DeleteServersTestJSON-1473674818 None] Deleting attachment 03374195-71b0-4897-9e2e-9d1b00cea65b. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "cinder-07818e2d-cb13-4e50-b34c-634d2751d626-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "cinder-07818e2d-cb13-4e50-b34c-634d2751d626-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "cinder-quobyte-07818e2d-cb13-4e50-b34c-634d2751d626" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "cinder-quobyte-07818e2d-cb13-4e50-b34c-634d2751d626" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[96142ab2-f2fd-47d3-bffd-c9b8876058a0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:05:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:37 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 Sep 28 17:05:37 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626" returned: 0 in 0.467s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:38 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626 Sep 28 17:05:38 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:38 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07818e2d-cb13-4e50-b34c-634d2751d626" returned: 0 in 0.302s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "cinder-quobyte-07818e2d-cb13-4e50-b34c-634d2751d626" released by "delete_volume" :: held 0.846s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Created reservations ['5cbe3409-8497-4a5e-b9a1-13718f496afe', '23ddbb25-aad9-490b-a183-f4a792bc5af0', '65d00b13-f309-445e-8a5a-cf8941ab83b0', '1cbedc8d-3033-4a08-afd8-76ede869b73b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:38 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:05:38 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:39 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:39 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:39 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Deleted volume successfully. Sep 28 17:05:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8148e569-11a8-4940-9437-7b503adba14a tempest-DeleteServersTestJSON-1473674818 None] Lock "cinder-07818e2d-cb13-4e50-b34c-634d2751d626-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:44 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:05:44 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:45 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.630s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:05:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:05:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 8 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:05:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Flow 'volume_create_manager' (5c963e8e-854a-48fa-8d7e-8bcd8fa35119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504341ff-146f-42d9-b9c5-284ebb1336a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (504341ff-146f-42d9-b9c5-284ebb1336a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1415306451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3038c681-f09d-4e14-ad7c-fdc9bec4a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4537e82bd04abea292c82d08377c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:46Z,use_quota=True,user_id='032e85b90b644ee48cf7435703e2fe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45870ae-ce81-473f-925f-910ff10db0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45870ae-ce81-473f-925f-910ff10db0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b128a91a-c7d1-46a0-b131-efddc2e2a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b128a91a-c7d1-46a0-b131-efddc2e2a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3038c681-f09d-4e14-ad7c-fdc9bec4a7d8', 'volume_name': 'volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5869eacb-d794-4a2b-8c4c-4d168ef2b831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5869eacb-d794-4a2b-8c4c-4d168ef2b831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2cb960-6c42-4160-8db4-f7d8ae487cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:46 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Volume 3038c681-f09d-4e14-ad7c-fdc9bec4a7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8', 'volume_size': 1} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1415306451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3038c681-f09d-4e14-ad7c-fdc9bec4a7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b4537e82bd04abea292c82d08377c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:05:46Z,use_quota=True,user_id='032e85b90b644ee48cf7435703e2fe44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Creating volume 3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:05:46 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:05:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:46 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 1073741824 Sep 28 17:05:46 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:47 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 1073741824" returned: 0 in 0.942s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:05:47 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 Sep 28 17:05:47 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:05:48 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" returned: 0 in 0.625s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2cb960-6c42-4160-8db4-f7d8ae487cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca9bc50-e336-43b6-8faf-14795e13e0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:05:48 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Volume volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 (3038c681-f09d-4e14-ad7c-fdc9bec4a7d8): created successfully Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca9bc50-e336-43b6-8faf-14795e13e0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:05:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Flow 'volume_create_manager' (5c963e8e-854a-48fa-8d7e-8bcd8fa35119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:05:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c335789c-0f8f-4ca1-b112-5f3812be0ef6 tempest-AttachVolumeShelveTestJSON-1537308234 None] Created volume successfully. Sep 28 17:05:58 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=30,cinder:UPDATE=32,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:05:58 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=35,cinder:UPDATE=36,cinder:INSERT=5,cinder:DELETE=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (a19dcf1f-6884-401d-b0dc-c4c8bab05165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d74627-fb42-4784-aabd-d9c21aced243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d74627-fb42-4784-aabd-d9c21aced243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1836062894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ae28a8-aff7-4c11-aea5-a5011a2d2caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce238473164ff49acc50ff3489c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:01Z,use_quota=True,user_id='c20d02bed3584ebabe5a58812c04f9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa957a3-4b6f-4d59-ab6f-6257045bced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa957a3-4b6f-4d59-ab6f-6257045bced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466195f1-7030-465f-9039-345f2a12518f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466195f1-7030-465f-9039-345f2a12518f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ae28a8-aff7-4c11-aea5-a5011a2d2caf', 'volume_name': 'volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326969df-4b54-479a-ba69-37edc42e475a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326969df-4b54-479a-ba69-37edc42e475a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9198dd8-d00f-4cf9-aec0-efa4e696f015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf', 'volume_size': 1} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1836062894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ae28a8-aff7-4c11-aea5-a5011a2d2caf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce238473164ff49acc50ff3489c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:01Z,use_quota=True,user_id='c20d02bed3584ebabe5a58812c04f9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Creating volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:06:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:01 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf 1073741824 Sep 28 17:06:01 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:02 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf 1073741824" returned: 0 in 0.717s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:02 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:02 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:02 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.335s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9198dd8-d00f-4cf9-aec0-efa4e696f015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba494c-dd67-430f-9e99-345aaeb0bee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Volume volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf (20ae28a8-aff7-4c11-aea5-a5011a2d2caf): created successfully Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ba494c-dd67-430f-9e99-345aaeb0bee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (a19dcf1f-6884-401d-b0dc-c4c8bab05165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fa48c9c1-6943-4fcc-9094-5ca01c300c59 tempest-VolumesDeleteCascade-726870928 None] Created volume successfully. Sep 28 17:06:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Creating offline snapshot 1461815e-f2d2-4acb-a242-6cf76d451a7a of volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:06:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e69556-db43-443c-a1d7-a4b28ebd4264]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:04 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:04 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:04 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.749s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:04 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a 1G Sep 28 17:06:04 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-6fc670a8-5b11-4831-a19f-46c05a55717e req-baa49e57-4ff6-4ae7-8d6f-406ca8a89b1f tempest-AttachVolumeShelveTestJSON-1537308234 None] No connector for attachment bcfbc9bd-4479-490d-955c-946d7c9e6d9c; skipping storage backend terminate_connection call. {{(pid=86842) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 17:06:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-6fc670a8-5b11-4831-a19f-46c05a55717e req-baa49e57-4ff6-4ae7-8d6f-406ca8a89b1f tempest-AttachVolumeShelveTestJSON-1537308234 None] Deleting attachment bcfbc9bd-4479-490d-955c-946d7c9e6d9c. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:06:05 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a 1G" returned: 0 in 0.751s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:05 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:05 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.607s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a is being set with open permissions: ugo+rw Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[89960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:06 devstack sudo[89960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[89960]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info Sep 28 17:06:06 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:06 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info" returned: 0 in 0.342s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:06 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info is being set with open permissions: ugo+rw Sep 28 17:06:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:06 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info Sep 28 17:06:06 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:07 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.info" returned: 0 in 0.305s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c0f0e7f3-9c9a-44f6-a23c-5ec8122e36ab tempest-VolumesDeleteCascade-726870928 None] Create snapshot completed successfully Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Creating offline snapshot e70888ef-dc43-452f-981b-3db5304e19c9 of volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77ce4be-ad56-4a52-984d-4318a742ef12]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e2faf81a-fc12-44ad-82c7-28e8bf961716 req-b8b2a832-81fc-404e-b2ba-ed1de70b3b4f tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:08 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:08 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:09 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.643s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:09 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 1G Sep 28 17:06:09 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:09 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 1G" returned: 0 in 0.629s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:09 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:09 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:10 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.347s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:10 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 is being set with open permissions: ugo+rw Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:10 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:10 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:10 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.403s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e2faf81a-fc12-44ad-82c7-28e8bf961716 req-b8b2a832-81fc-404e-b2ba-ed1de70b3b4f tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.873s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e2faf81a-fc12-44ad-82c7-28e8bf961716 req-b8b2a832-81fc-404e-b2ba-ed1de70b3b4f tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b501df5b-14d4-4087-853f-5ffe004b2113 tempest-VolumesDeleteCascade-726870928 None] Create snapshot completed successfully Sep 28 17:06:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-e2faf81a-fc12-44ad-82c7-28e8bf961716 req-b8b2a832-81fc-404e-b2ba-ed1de70b3b4f tempest-ServerActionsTestOtherA-963292488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-931abb83-8dec-4f80-8c98-1a9f23bc4596', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b59a1d40-6c2f-4264-8c2a-26fc713e5563', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-e2faf81a-fc12-44ad-82c7-28e8bf961716 req-b8b2a832-81fc-404e-b2ba-ed1de70b3b4f tempest-ServerActionsTestOtherA-963292488 None] attachment_update completed successfully. Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-20ae28a8-aff7-4c11-aea5-a5011a2d2caf-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-20ae28a8-aff7-4c11-aea5-a5011a2d2caf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Performing cascade delete. {{(pid=86842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-1461815e-f2d2-4acb-a242-6cf76d451a7a-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-1461815e-f2d2-4acb-a242-6cf76d451a7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-1461815e-f2d2-4acb-a242-6cf76d451a7a" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1461815e-f2d2-4acb-a242-6cf76d451a7a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Deleting offline snapshot 1461815e-f2d2-4acb-a242-6cf76d451a7a of volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:06:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] snapshot_file for this snap is: volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[be847b28-6bea-4a2d-a344-ce13cbc5d9b8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:12 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:12 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:12 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.640s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6072088f-878f-4d66-86c9-ef034dded62b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:12 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:12 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:13 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.593s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[379c437d-ab17-4fc0-905c-6d909ebd323a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:13 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:13 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:13 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.585s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded4c8e-c354-408d-a78e-adbbc34b1e3e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:14 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:14 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:14 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.598s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5478f4-7e0f-482e-8cc9-5b808207da56]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:14 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:14 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:15 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.831s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:15 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:15 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:16 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.615s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:16 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a Sep 28 17:06:16 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-6abb3285-c94c-41fc-a4da-80dd4e4c4401 tempest-ServerActionsTestOtherA-963292488 None] Terminate volume connection completed successfully. Sep 28 17:06:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-6abb3285-c94c-41fc-a4da-80dd4e4c4401 tempest-ServerActionsTestOtherA-963292488 None] Deleting attachment b59a1d40-6c2f-4264-8c2a-26fc713e5563. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:06:16 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.1461815e-f2d2-4acb-a242-6cf76d451a7a" returned: 0 in 0.447s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 -F qcow2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:16 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 -F qcow2 Sep 28 17:06:16 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:17 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 -F qcow2" returned: 0 in 0.813s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1461815e-f2d2-4acb-a242-6cf76d451a7a" released by "_delete_snapshot" :: held 5.466s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" released by "delete_snapshot" :: held 5.525s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:17 devstack cinder-volume[86842]: WARNING cinder.quota [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['427445d5-bd98-40b7-9e4d-a44ee0219327', 'f66e726a-ebfc-44b2-8e08-7a085c8001e9', '7d913e48-d829-4094-bbfa-1e362426446a', '4c8b3487-83f0-4247-86d3-381cc5e5b3a1'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Delete snapshot completed successfully. Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-1461815e-f2d2-4acb-a242-6cf76d451a7a-delete_snapshot" released by "delete_snapshot" :: held 5.909s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-e70888ef-dc43-452f-981b-3db5304e19c9-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-e70888ef-dc43-452f-981b-3db5304e19c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-e70888ef-dc43-452f-981b-3db5304e19c9" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-e70888ef-dc43-452f-981b-3db5304e19c9" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Deleting offline snapshot e70888ef-dc43-452f-981b-3db5304e19c9 of volume 20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:06:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] snapshot_file for this snap is: volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a82fa5-4274-4b8b-99ed-01a4033db857]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-42091989-70af-4c0e-b857-90937a98b463 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-42091989-70af-4c0e-b857-90937a98b463 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-42091989-70af-4c0e-b857-90937a98b463 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-42091989-70af-4c0e-b857-90937a98b463 tempest-ServerActionsTestOtherA-963292488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-931abb83-8dec-4f80-8c98-1a9f23bc4596', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9134e125-0063-492a-a032-43dc67f7d927', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:06:18 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:18 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-e7fd7623-f434-478b-bbe9-56fc1a6e7eea req-42091989-70af-4c0e-b857-90937a98b463 tempest-ServerActionsTestOtherA-963292488 None] attachment_update completed successfully. Sep 28 17:06:18 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.846s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[96081554-1393-4e5f-8f7e-f3fc93b5e384]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:19 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:19 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:19 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.944s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:19 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:19 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:20 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.601s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:20 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9 Sep 28 17:06:20 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:21 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf.e70888ef-dc43-452f-981b-3db5304e19c9" returned: 0 in 0.878s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-e70888ef-dc43-452f-981b-3db5304e19c9" released by "_delete_snapshot" :: held 3.525s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" released by "delete_snapshot" :: held 3.567s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['df593bc5-5a8b-4b6d-93f7-7f11a8f9cc3d', '7ec381bb-a777-4ca9-8622-703d8bd549f9', '0cd04cc9-8dfe-40d1-ae71-689f60c98ba5', '68d8b55d-2f55-496e-bd0e-3dee88b4aefe'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Delete snapshot completed successfully. Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-e70888ef-dc43-452f-981b-3db5304e19c9-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Snapshots deleted, issuing volume delete {{(pid=86842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8b063-eec1-48f0-af62-54de9497038a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:22 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:22 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:22 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.741s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:22 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf Sep 28 17:06:22 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:22 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-20ae28a8-aff7-4c11-aea5-a5011a2d2caf" released by "delete_volume" :: held 1.226s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['7af652fc-3b88-4901-b68a-64dd4ff60f5d', 'c9481b53-7ed7-417c-9167-7d085a02dd1c', '83e0170a-343c-4ebd-9ce2-0384c72a6036', 'f8118804-1759-45dc-a476-0d5863ce522f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:23 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:06:23 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:23 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:23 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Deleted volume successfully. Sep 28 17:06:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-535625a2-0b6a-4a14-b5a6-172106f37142 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-20ae28a8-aff7-4c11-aea5-a5011a2d2caf-delete_volume" released by "delete_volume" :: held 12.035s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (fd4b421a-5b63-4fcf-bba8-dcd7818168e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff5149d-ab07-4809-9043-75d45a4e7791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff5149d-ab07-4809-9043-75d45a4e7791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1225474518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c1047-f5fc-49f0-908a-1f341e8f9060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce238473164ff49acc50ff3489c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:25Z,use_quota=True,user_id='c20d02bed3584ebabe5a58812c04f9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fba3a8-680c-41bf-b738-70aaa54fffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53fba3a8-680c-41bf-b738-70aaa54fffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3204c33-727f-4909-8b19-f7d2f2a782ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3204c33-727f-4909-8b19-f7d2f2a782ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '356c1047-f5fc-49f0-908a-1f341e8f9060', 'volume_name': 'volume-356c1047-f5fc-49f0-908a-1f341e8f9060', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e98cdea-26a7-496e-8237-6b1ffeb395f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e98cdea-26a7-496e-8237-6b1ffeb395f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30ff81d-84cb-4a79-aa52-1b92695ea87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:25 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Volume 356c1047-f5fc-49f0-908a-1f341e8f9060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-356c1047-f5fc-49f0-908a-1f341e8f9060', 'volume_size': 1} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1225474518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=356c1047-f5fc-49f0-908a-1f341e8f9060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce238473164ff49acc50ff3489c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:25Z,use_quota=True,user_id='c20d02bed3584ebabe5a58812c04f9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Creating volume 356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:25 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:06:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:25 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 1073741824 Sep 28 17:06:25 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:27 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 1073741824" returned: 0 in 1.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:27 devstack sudo[91218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:27 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:27 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 0.567s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c30ff81d-84cb-4a79-aa52-1b92695ea87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-356c1047-f5fc-49f0-908a-1f341e8f9060', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c68df-174c-49d1-94d7-0b8d753fa9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Volume volume-356c1047-f5fc-49f0-908a-1f341e8f9060 (356c1047-f5fc-49f0-908a-1f341e8f9060): created successfully Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2c68df-174c-49d1-94d7-0b8d753fa9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (fd4b421a-5b63-4fcf-bba8-dcd7818168e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-742f6805-f0f8-47e5-bab2-617771a6558e tempest-VolumesDeleteCascade-726870928 None] Created volume successfully. Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Creating offline snapshot 1f56d611-92b5-44e6-892b-194eb1d36688 of volume 356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15cad45-c0a0-4666-b188-df1a06bd4ad8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:29 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:29 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:29 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 0.661s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:29 devstack sudo[91229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 1G Sep 28 17:06:29 devstack sudo[91229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:30 devstack sudo[91229]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 1G" returned: 0 in 0.814s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356c1047-f5fc-49f0-908a-1f341e8f9060 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:30 devstack sudo[91235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356c1047-f5fc-49f0-908a-1f341e8f9060 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:30 devstack sudo[91235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[91235]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-356c1047-f5fc-49f0-908a-1f341e8f9060 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 is being set with open permissions: ugo+rw Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:31 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:31 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:31 devstack sudo[91243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info Sep 28 17:06:31 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Flow 'volume_create_manager' (6bbe5582-79e8-4208-9b2a-5f7a9844218c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e981d3-e53b-4900-beec-9a1ba8323106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e981d3-e53b-4900-beec-9a1ba8323106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1148786042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfde575-7d68-4bbd-a603-f408af1f0ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b13aaaadb8401a9a0873a558c6967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:32Z,use_quota=True,user_id='28fd3ec2971b4652bbe1fa15b059bffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aaf3bb-5d92-4096-98f6-68cf5679c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aaf3bb-5d92-4096-98f6-68cf5679c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c94594-dffb-4be7-849f-67dfe398d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c94594-dffb-4be7-849f-67dfe398d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfde575-7d68-4bbd-a603-f408af1f0ad5', 'volume_name': 'volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528f60d-d6ba-4679-a804-5a01384c9844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a528f60d-d6ba-4679-a804-5a01384c9844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a3a45d-d4b1-4d8d-bb70-08e1bb2e4292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Volume 9dfde575-7d68-4bbd-a603-f408af1f0ad5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5', 'volume_size': 1} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:32 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:32 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info is being set with open permissions: ugo+rw Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:32 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info Sep 28 17:06:32 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:32 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.info" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.177s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1148786042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfde575-7d68-4bbd-a603-f408af1f0ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98b13aaaadb8401a9a0873a558c6967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:32Z,use_quota=True,user_id='28fd3ec2971b4652bbe1fa15b059bffe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Creating volume 9dfde575-7d68-4bbd-a603-f408af1f0ad5 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:32 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:32 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 1073741824 Sep 28 17:06:32 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-460f8c45-d3b6-4992-a263-b8cec6497e3a tempest-VolumesDeleteCascade-726870928 None] Create snapshot completed successfully Sep 28 17:06:32 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 1073741824" returned: 0 in 0.568s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:33 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 Sep 28 17:06:33 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:33 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5" returned: 0 in 0.328s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19a3a45d-d4b1-4d8d-bb70-08e1bb2e4292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3733b451-5c2a-4e91-9a70-6f3370ff99aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Volume volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 (9dfde575-7d68-4bbd-a603-f408af1f0ad5): created successfully Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3733b451-5c2a-4e91-9a70-6f3370ff99aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Flow 'volume_create_manager' (6bbe5582-79e8-4208-9b2a-5f7a9844218c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-392de5db-d5c7-42fd-8b0e-80162edb6297 tempest-TaggedAttachmentsTest-1580406884 None] Created volume successfully. Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (47e47729-e0a0-4f27-af8b-b87fa7f368a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4844d001-b863-424f-b2f5-a849bc58d706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4844d001-b863-424f-b2f5-a849bc58d706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-429110485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=171a997f-2272-44fc-968f-39d975e8a7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ce238473164ff49acc50ff3489c364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1f56d611-92b5-44e6-892b-194eb1d36688,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:06:34Z,use_quota=True,user_id='c20d02bed3584ebabe5a58812c04f9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcc3ec7-3f97-48df-b1d0-6e8fce57dcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcc3ec7-3f97-48df-b1d0-6e8fce57dcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9186d8a-cc28-4f39-b015-1a09ff0c097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9186d8a-cc28-4f39-b015-1a09ff0c097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '171a997f-2272-44fc-968f-39d975e8a7d4', 'volume_name': 'volume-171a997f-2272-44fc-968f-39d975e8a7d4', 'volume_size': 1, 'snapshot_id': '1f56d611-92b5-44e6-892b-194eb1d36688'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e16fef7-1f4f-43e2-8ecd-a9317a6e608a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e16fef7-1f4f-43e2-8ecd-a9317a6e608a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d7aeea-0fc6-4a12-86bb-2fd244656f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Volume 171a997f-2272-44fc-968f-39d975e8a7d4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-171a997f-2272-44fc-968f-39d975e8a7d4', 'volume_size': 1, 'snapshot_id': '1f56d611-92b5-44e6-892b-194eb1d36688'} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688-171a997f-2272-44fc-968f-39d975e8a7d4" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688-171a997f-2272-44fc-968f-39d975e8a7d4" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Creating volume 171a997f-2272-44fc-968f-39d975e8a7d4 from snapshot 1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] snapshot: 1f56d611-92b5-44e6-892b-194eb1d36688, volume: 171a997f-2272-44fc-968f-39d975e8a7d4, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f64ca-f446-4fd8-9f1d-8d26c67d6d12]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:34 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:34 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:35 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.584s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-356c1047-f5fc-49f0-908a-1f341e8f9060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a7627-c4db-49e2-b4b2-db998b4849ef]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:35 devstack sudo[91263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:35 devstack sudo[91263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:36 devstack sudo[91263]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 0.861s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:06:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:06:36 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:06:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:36 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 Sep 28 17:06:36 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=37,cinder:SELECT=43,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:44 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:06:44 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:44 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=54,cinder:UPDATE=35,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:06:45 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.695s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:06:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 8 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:06:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:06:47 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4" returned: 0 in 10.943s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060, size 1024.00 MB, duration 10.94 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:06:47 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Converted 1024.00 MB image at 93.57 MB/s Sep 28 17:06:47 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 is being set with open permissions: ugo+rw Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:47 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 Sep 28 17:06:47 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:47 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" released by "_copy_volume_from_snapshot" :: held 12.961s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688-171a997f-2272-44fc-968f-39d975e8a7d4" released by "_create_volume_from_snapshot" :: held 13.059s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.078s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d7aeea-0fc6-4a12-86bb-2fd244656f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-171a997f-2272-44fc-968f-39d975e8a7d4', 'volume_size': 1, 'snapshot_id': '1f56d611-92b5-44e6-892b-194eb1d36688'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef17bc-c875-4f12-aae5-4f0b1ec8be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:06:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Volume volume-171a997f-2272-44fc-968f-39d975e8a7d4 (171a997f-2272-44fc-968f-39d975e8a7d4): created successfully Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef17bc-c875-4f12-aae5-4f0b1ec8be30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:06:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Flow 'volume_create_manager' (47e47729-e0a0-4f27-af8b-b87fa7f368a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:06:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-30d165da-9908-4e37-87e3-451f4fc99b32 tempest-VolumesDeleteCascade-726870928 None] Created volume successfully. Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-356c1047-f5fc-49f0-908a-1f341e8f9060-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-356c1047-f5fc-49f0-908a-1f341e8f9060-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Performing cascade delete. {{(pid=86842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-1f56d611-92b5-44e6-892b-194eb1d36688-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-1f56d611-92b5-44e6-892b-194eb1d36688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Deleting offline snapshot 1f56d611-92b5-44e6-892b-194eb1d36688 of volume 356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] snapshot_file for this snap is: volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ec0c2-72b0-46eb-bd6d-24a6d1e4c924]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:49 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:49 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.406s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-356c1047-f5fc-49f0-908a-1f341e8f9060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:06:49 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c0cadc-00eb-403d-9c71-094e5af96be7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:49 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:49 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:50 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 1.053s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:50 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:50 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:51 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.772s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:51 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688 Sep 28 17:06:51 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:51 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060.1f56d611-92b5-44e6-892b-194eb1d36688" returned: 0 in 0.362s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-1f56d611-92b5-44e6-892b-194eb1d36688" released by "_delete_snapshot" :: held 2.746s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" released by "delete_snapshot" :: held 2.773s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['32f0c36e-64e1-44bd-8d80-250fd78ae249', '4ea46b6a-bf42-48cd-805d-3b14b933d78a', 'ae62fabd-ecfb-4a11-b6ef-c7e3b81b9b5d', '0722d5ba-2d1e-4fe5-999d-ded83f3ab3c5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Delete snapshot completed successfully. Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-1f56d611-92b5-44e6-892b-194eb1d36688-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Snapshots deleted, issuing volume delete {{(pid=86842) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 17:06:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a1ec27-b8d8-476c-9898-0e3c55250327]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:52 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:52 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:52 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 0.780s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:52 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060 Sep 28 17:06:52 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:53 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-356c1047-f5fc-49f0-908a-1f341e8f9060" returned: 0 in 0.479s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-356c1047-f5fc-49f0-908a-1f341e8f9060" released by "delete_volume" :: held 1.425s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['292627fa-b35a-4b52-9c97-93e18355a311', '9bbce5b3-7ed1-4c30-80b5-643c0c5a6347', '1c8752d3-1162-4f9a-9c41-cd9cc03b3183', '1a8ce429-7a7e-4c58-9edb-3c024994b3cb'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:53 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:06:53 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:54 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.648s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Deleted volume successfully. Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-414c271a-00f9-4de8-b783-d66cf8893a64 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-356c1047-f5fc-49f0-908a-1f341e8f9060-delete_volume" released by "delete_volume" :: held 5.760s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-171a997f-2272-44fc-968f-39d975e8a7d4-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-171a997f-2272-44fc-968f-39d975e8a7d4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d1ffc4-f405-4ea6-b143-fc1ea2658ce9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:55 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 Sep 28 17:06:55 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:55 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4" returned: 0 in 0.703s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:55 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4 Sep 28 17:06:55 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:56 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-171a997f-2272-44fc-968f-39d975e8a7d4" returned: 0 in 0.548s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-quobyte-171a997f-2272-44fc-968f-39d975e8a7d4" released by "delete_volume" :: held 1.312s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Created reservations ['f80a3e87-1ef1-47ac-9578-a20ff26fea03', 'c1df8a79-4af2-4ab0-8157-aca0bfcf7a02', 'bafbbff3-06e1-4cfc-b4a8-b0be1fc50206', '7d27ac90-f58e-4fb3-ba27-3fc668e485ae'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:56 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:06:56 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:57 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.454s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Deleted volume successfully. Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7f3f5870-94f1-49d7-a935-ca42fd3a79b0 tempest-VolumesDeleteCascade-726870928 None] Lock "cinder-171a997f-2272-44fc-968f-39d975e8a7d4-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Acquiring lock "cinder-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "cinder-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Acquiring lock "cinder-quobyte-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "cinder-quobyte-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e6ce61-a69d-4e70-bc20-1e50de6b1e20]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:06:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:57 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 Sep 28 17:06:57 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" returned: 0 in 0.548s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:58 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8 Sep 28 17:06:58 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:58 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" returned: 0 in 0.451s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "cinder-quobyte-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8" released by "delete_volume" :: held 1.079s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Created reservations ['40391b54-4ec7-4852-83a7-dff4e71bf2ce', '1add524d-cee3-4412-8260-d1dd995642f2', '5d8b2877-5bd3-4102-9d8e-af377e9ce9b9', '0e5d9788-6a0f-4707-9ac0-fdbf5209f3c4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:06:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:06:58 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:06:58 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:06:59 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 28 17:06:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:06:59 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:06:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Deleted volume successfully. Sep 28 17:06:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e65bb8a-0cf5-4ea8-bdb4-f9965a040749 tempest-AttachVolumeShelveTestJSON-1537308234 None] Lock "cinder-3038c681-f09d-4e14-ad7c-fdc9bec4a7d8-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (8fb4ea38-0ce6-42e5-ad8a-17e9c136653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31777a34-9b8c-4803-a5aa-4b2999328cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31777a34-9b8c-4803-a5aa-4b2999328cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-979535145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9184210c-9868-4495-bd94-d636c57cbf17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:03Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477f1d6e-5d8b-4007-8019-f1f594506fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477f1d6e-5d8b-4007-8019-f1f594506fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f8c8f5-ad41-4934-9784-a58b76c3d189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f8c8f5-ad41-4934-9784-a58b76c3d189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9184210c-9868-4495-bd94-d636c57cbf17', 'volume_name': 'volume-9184210c-9868-4495-bd94-d636c57cbf17', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eebd9e9-7385-4218-a934-19b87977ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eebd9e9-7385-4218-a934-19b87977ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdf2ff-2daa-45b4-8b8b-e5ef08546a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Volume 9184210c-9868-4495-bd94-d636c57cbf17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9184210c-9868-4495-bd94-d636c57cbf17', 'volume_size': 1} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-979535145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9184210c-9868-4495-bd94-d636c57cbf17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:03Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Creating volume 9184210c-9868-4495-bd94-d636c57cbf17 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:03 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 1073741824 Sep 28 17:07:03 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:03 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 1073741824" returned: 0 in 0.593s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:03 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 Sep 28 17:07:03 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:04 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cdf2ff-2daa-45b4-8b8b-e5ef08546a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9184210c-9868-4495-bd94-d636c57cbf17', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963a6cbf-76e1-4f15-95dc-d4bf3646a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Volume volume-9184210c-9868-4495-bd94-d636c57cbf17 (9184210c-9868-4495-bd94-d636c57cbf17): created successfully Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963a6cbf-76e1-4f15-95dc-d4bf3646a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (8fb4ea38-0ce6-42e5-ad8a-17e9c136653b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4b28816c-27d7-4d5b-b45e-0f9b0cbd6b08 tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (f18e28d0-ad36-4a9c-a937-d418909cb85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92049316-4c25-46e1-bdbb-d8734dfc1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92049316-4c25-46e1-bdbb-d8734dfc1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1962909977',display_name='tempest-VolumesGetTest-Volume-1512431258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d15792f-3466-4e00-b05d-a144363e1ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:06Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad815ad-b429-4c8d-a0e0-9736c049e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad815ad-b429-4c8d-a0e0-9736c049e55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948e4800-e3c8-477b-afff-ee0a30c6ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948e4800-e3c8-477b-afff-ee0a30c6ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d15792f-3466-4e00-b05d-a144363e1ab1', 'volume_name': 'volume-9d15792f-3466-4e00-b05d-a144363e1ab1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb4566-4f7f-40bd-bacf-334522b144d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb4566-4f7f-40bd-bacf-334522b144d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c663b6e8-9f7b-48d4-864e-5b1749d5c911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Volume 9d15792f-3466-4e00-b05d-a144363e1ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d15792f-3466-4e00-b05d-a144363e1ab1', 'volume_size': 1} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1962909977',display_name='tempest-VolumesGetTest-Volume-1512431258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d15792f-3466-4e00-b05d-a144363e1ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:06Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Creating volume 9d15792f-3466-4e00-b05d-a144363e1ab1 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:06 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:06 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 1073741824 Sep 28 17:07:06 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 1073741824" returned: 0 in 0.764s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:07 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 Sep 28 17:07:07 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:07 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1" returned: 0 in 0.472s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c663b6e8-9f7b-48d4-864e-5b1749d5c911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d15792f-3466-4e00-b05d-a144363e1ab1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63182927-7ec2-4af7-9d8a-3e57096e14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Volume volume-9d15792f-3466-4e00-b05d-a144363e1ab1 (9d15792f-3466-4e00-b05d-a144363e1ab1): created successfully Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63182927-7ec2-4af7-9d8a-3e57096e14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (f18e28d0-ad36-4a9c-a937-d418909cb85a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7dcaceba-758f-4125-9342-69963e12bf66 tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:07:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-c2f0a586-d236-4066-a1fd-b29a86f701ed req-17b3437d-93b0-4b3b-a9b4-42620d97c6b2 tempest-ServerActionsTestOtherA-963292488 None] Terminate volume connection completed successfully. Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-c2f0a586-d236-4066-a1fd-b29a86f701ed req-17b3437d-93b0-4b3b-a9b4-42620d97c6b2 tempest-ServerActionsTestOtherA-963292488 None] Deleting attachment 9134e125-0063-492a-a032-43dc67f7d927. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-9d15792f-3466-4e00-b05d-a144363e1ab1-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "cinder-9d15792f-3466-4e00-b05d-a144363e1ab1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-9d15792f-3466-4e00-b05d-a144363e1ab1" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-9d15792f-3466-4e00-b05d-a144363e1ab1" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a9a73a-d4d1-47f1-ade5-bcd6e851027d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:09 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 Sep 28 17:07:09 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:09 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1" returned: 0 in 0.510s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:09 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1 Sep 28 17:07:09 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:09 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9d15792f-3466-4e00-b05d-a144363e1ab1" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-9d15792f-3466-4e00-b05d-a144363e1ab1" released by "delete_volume" :: held 1.026s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Created reservations ['2e0ee586-2b96-4731-982c-d7d0ddafd1d2', '6be363b0-36c6-4425-af34-e39d5a27c2fd', '9741318a-5646-41ea-a1bd-0b7687ab1c31', '053a6036-01f3-4806-ba56-a764472b48aa'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:10 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:10 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:10 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.326s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:07:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4e82b93d-b49a-4279-805d-cad710869104 tempest-VolumesGetTest-1320749060 None] Lock "cinder-9d15792f-3466-4e00-b05d-a144363e1ab1-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-9184210c-9868-4495-bd94-d636c57cbf17-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "cinder-9184210c-9868-4495-bd94-d636c57cbf17-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-9184210c-9868-4495-bd94-d636c57cbf17" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-9184210c-9868-4495-bd94-d636c57cbf17" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bb5473-462c-469f-a4b5-30ba969605ed]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:11 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 Sep 28 17:07:11 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:11 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17" returned: 0 in 0.628s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:12 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17 Sep 28 17:07:12 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:12 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9184210c-9868-4495-bd94-d636c57cbf17" returned: 0 in 0.347s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-9184210c-9868-4495-bd94-d636c57cbf17" released by "delete_volume" :: held 1.055s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Created reservations ['a14a113c-600e-47dd-a256-b1f89323b2f3', '5727273f-4b21-47d0-b45d-1ccf0a87e00a', '90e43709-3ce1-49cb-ba7f-b043d8e81677', '4818d7ed-44e1-4494-bb0f-d5c5b040d77e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:12 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:12 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:13 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.509s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:07:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d647f70b-02d5-4aa7-8181-84e04ecea281 tempest-VolumesGetTest-1320749060 None] Lock "cinder-9184210c-9868-4495-bd94-d636c57cbf17-delete_volume" released by "delete_volume" :: held 1.946s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (ed4ebcea-0a7d-477a-b871-de49dc61a5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728d300f-e261-4330-bcb6-360cdbee27b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728d300f-e261-4330-bcb6-360cdbee27b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1504344088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:14Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabcac7-278b-490a-ac7b-5e74c787f8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edabcac7-278b-490a-ac7b-5e74c787f8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e5a724-cf53-4422-8fd4-49618ff94bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e5a724-cf53-4422-8fd4-49618ff94bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'volume_name': 'volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d6c3a4-fae1-4527-a3f0-4eb143f561f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d6c3a4-fae1-4527-a3f0-4eb143f561f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fa7bcf-4909-4bd5-b3bb-8a6d650f3208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Volume 7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'volume_size': 1} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1504344088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:14Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Creating volume 7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:14 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:14 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 1073741824 Sep 28 17:07:14 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:15 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 1073741824" returned: 0 in 0.765s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:15 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:15 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:15 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 0.549s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fa7bcf-4909-4bd5-b3bb-8a6d650f3208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c895cd6d-6269-4e47-88b3-50569cbc7aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Volume volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 (7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45): created successfully Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c895cd6d-6269-4e47-88b3-50569cbc7aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (ed4ebcea-0a7d-477a-b871-de49dc61a5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c1406192-c63b-47bb-9c61-d93c94c7c407 tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (aa0d5575-44e6-4ca6-8fe8-74685c06577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12302693-8cb5-4d0e-9aa3-7f3cf9e19d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12302693-8cb5-4d0e-9aa3-7f3cf9e19d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-222333595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dd49730-1b34-4ebc-88d3-3b183c3c79ea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:17Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3d8f3-8550-4422-9932-a8cd6a9ad0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c3d8f3-8550-4422-9932-a8cd6a9ad0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8000e86c-251d-4196-9156-2d1455d1c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8000e86c-251d-4196-9156-2d1455d1c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2dd49730-1b34-4ebc-88d3-3b183c3c79ea', 'volume_name': 'volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea', 'volume_size': 1, 'source_volid': '7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'source_volstatus': 'available'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f7d59e-42e9-4db7-8023-b8da2d4f1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f7d59e-42e9-4db7-8023-b8da2d4f1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87932f5-918a-4b5e-a81a-26c162dbaa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Volume 2dd49730-1b34-4ebc-88d3-3b183c3c79ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea', 'volume_size': 1, 'source_volid': '7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'source_volstatus': 'available'} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:17 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Cloning volume 7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 to volume 2dd49730-1b34-4ebc-88d3-3b183c3c79ea Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Creating offline snapshot 1032b498-03c0-465c-9794-898e40fc47bf of volume 7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6104b8-b519-4963-9907-ce127ffb9322]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:17 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:17 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 0.672s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:18 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf 1G Sep 28 17:07:18 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Flow 'volume_create_manager' (7b42a4ce-4519-434f-9f3d-67a528d05227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97563ec4-19df-4da7-935f-f45e2c81d7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97563ec4-19df-4da7-935f-f45e2c81d7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-654939361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0526e02-f2de-45db-81cf-17142824871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c8e3ec94c5492a96e678071c52159b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:18Z,use_quota=True,user_id='ec64040e081446a7aee5f98cecaeda2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d1a6da-04f6-4329-b4d5-8a9adb3c5e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32d1a6da-04f6-4329-b4d5-8a9adb3c5e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbc2e85-2c61-4cfa-9b43-d7e26b85e8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:18 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:07:19 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf 1G" returned: 0 in 0.698s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:19 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:19 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bbc2e85-2c61-4cfa-9b43-d7e26b85e8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0526e02-f2de-45db-81cf-17142824871e', 'volume_name': 'volume-c0526e02-f2de-45db-81cf-17142824871e', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da584643-00bd-459b-8444-a89f63b149e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da584643-00bd-459b-8444-a89f63b149e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7854b8a-8319-4d4b-b63f-7fa7fe894030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Volume c0526e02-f2de-45db-81cf-17142824871e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0526e02-f2de-45db-81cf-17142824871e', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Trying to clone c0526e02-f2de-45db-81cf-17142824871e from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de at location (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:07:19 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:19 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf is being set with open permissions: ugo+rw Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:19 devstack sudo[91752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:19 devstack sudo[91752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:19 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:07:19 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:07:20 devstack sudo[91752]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.472s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f336f3-b40a-4cba-9563-430e30e75382]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info Sep 28 17:07:20 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD Sep 28 17:07:20 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de is fetched for user ec64040e081446a7aee5f98cecaeda2c. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:07:20 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info" returned: 0 in 0.535s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:20 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info is being set with open permissions: ugo+rw Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info Sep 28 17:07:20 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5604e8c4-1b92-4810-a220-f6baa5b1c487]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:20 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD Sep 28 17:07:20 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:21 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.info" returned: 0 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] snapshot: 1032b498-03c0-465c-9794-898e40fc47bf, volume: 2dd49730-1b34-4ebc-88d3-3b183c3c79ea, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ffbe28-c5d6-4991-bfef-7eb0fdcdf82e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:21 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:21 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:21 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:21 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.634s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af3a729-1964-4b06-a5ef-635d34533b8c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:21 devstack sudo[91778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:21 devstack sudo[91778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:22 devstack sudo[91778]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 0.557s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:07:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:07:22 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:07:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:22 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea Sep 28 17:07:22 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:30 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=49,cinder:UPDATE=63,cinder:DELETE=5,cinder:INSERT=14 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:30 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=54,cinder:INSERT=17,cinder:SELECT=41,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:07:32 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" returned: 0 in 10.111s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45, size 1024.00 MB, duration 10.11 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:07:32 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Converted 1024.00 MB image at 101.26 MB/s Sep 28 17:07:32 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea is being set with open permissions: ugo+rw Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:32 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea Sep 28 17:07:32 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b68ddf24-f701-4661-aa8b-87ebca1f87f2 req-85d55986-41bd-45fe-a80f-3c5790e2601d tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:32 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" returned: 0 in 0.283s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" released by "_copy_volume_from_snapshot" :: held 11.713s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-1032b498-03c0-465c-9794-898e40fc47bf" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-1032b498-03c0-465c-9794-898e40fc47bf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Deleting offline snapshot 1032b498-03c0-465c-9794-898e40fc47bf of volume 7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] snapshot_file for this snap is: volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b011f99-1dbb-4b2a-a45c-2413faa8faab]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:32 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:32 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.457s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdbb458-a5fc-43e5-a9f9-ea6d0f038756]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:33 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:33 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 0.593s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:33 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:33 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:34 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.473s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:34 devstack sudo[91892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf Sep 28 17:07:34 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:34 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45.1032b498-03c0-465c-9794-898e40fc47bf" returned: 0 in 0.328s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-1032b498-03c0-465c-9794-898e40fc47bf" released by "_delete_snapshot" :: held 1.975s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.279s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.504s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-654939361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0526e02-f2de-45db-81cf-17142824871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3c8e3ec94c5492a96e678071c52159b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:18Z,use_quota=True,user_id='ec64040e081446a7aee5f98cecaeda2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Creating volume c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:34 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:34 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1073741824 Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87932f5-918a-4b5e-a81a-26c162dbaa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea', 'volume_size': 1, 'source_volid': '7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45', 'source_volstatus': 'available'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:34 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169de015-adf9-4520-b3ea-bd6bacfde038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Volume volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea (2dd49730-1b34-4ebc-88d3-3b183c3c79ea): created successfully Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169de015-adf9-4520-b3ea-bd6bacfde038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (aa0d5575-44e6-4ca6-8fe8-74685c06577d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-54bdc33f-0d4e-4f4b-8ca2-98aad52f7734 tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:07:35 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1073741824" returned: 0 in 0.652s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:35 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e Sep 28 17:07:35 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:35 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e" returned: 0 in 0.376s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b68ddf24-f701-4661-aa8b-87ebca1f87f2 req-85d55986-41bd-45fe-a80f-3c5790e2601d tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.357s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b68ddf24-f701-4661-aa8b-87ebca1f87f2 req-85d55986-41bd-45fe-a80f-3c5790e2601d tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:35 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Attempting download of 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume c0526e02-f2de-45db-81cf-17142824871e. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-b68ddf24-f701-4661-aa8b-87ebca1f87f2 req-85d55986-41bd-45fe-a80f-3c5790e2601d tempest-TaggedAttachmentsTest-1580406884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a8ab267-2a73-4bfa-a76a-1d06b243a33f', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f4095-9c2d-4745-a2dd-4ea46ad61eed]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:36 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-b68ddf24-f701-4661-aa8b-87ebca1f87f2 req-85d55986-41bd-45fe-a80f-3c5790e2601d tempest-TaggedAttachmentsTest-1580406884 None] attachment_update completed successfully. Sep 28 17:07:36 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd Sep 28 17:07:36 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (2fb5e4b0-e24f-4bd2-96a0-895fd0fa716b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:36 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049042c2-b3c6-48ae-b7ab-df34e69dad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd" returned: 0 in 0.706s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049042c2-b3c6-48ae-b7ab-df34e69dad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1202345365',display_name='tempest-VolumesGetTest-Volume-1019971694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b939814c-ac4e-462b-9492-df4e91d8fca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:37Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8989b0d-e125-4595-b2de-80582b9b54c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8989b0d-e125-4595-b2de-80582b9b54c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a34672-98ba-4fc7-8116-56c135f39f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a34672-98ba-4fc7-8116-56c135f39f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b939814c-ac4e-462b-9492-df4e91d8fca1', 'volume_name': 'volume-b939814c-ac4e-462b-9492-df4e91d8fca1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9017cd9e-222c-413f-9b09-5a6bb7aee56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9017cd9e-222c-413f-9b09-5a6bb7aee56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b55a62-d226-408e-a7f2-010d7d944c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:36 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Volume b939814c-ac4e-462b-9492-df4e91d8fca1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b939814c-ac4e-462b-9492-df4e91d8fca1', 'volume_size': 1} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1202345365',display_name='tempest-VolumesGetTest-Volume-1019971694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b939814c-ac4e-462b-9492-df4e91d8fca1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:37Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Creating volume b939814c-ac4e-462b-9492-df4e91d8fca1 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:36 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:37 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 1073741824 Sep 28 17:07:37 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:37 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd Sep 28 17:07:37 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:37 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd" returned: 1 in 0.680s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_qyujwqvd' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe63b06-24c9-4749-a06c-5bcaf40c252e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:37 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD Sep 28 17:07:37 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:37 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 1073741824" returned: 0 in 0.778s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:37 devstack sudo[92359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 Sep 28 17:07:37 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:38 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1" returned: 0 in 0.382s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:38 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b55a62-d226-408e-a7f2-010d7d944c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b939814c-ac4e-462b-9492-df4e91d8fca1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61588318-ab0b-42a8-a8b8-2e6856fe5a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] 40f838d7-edca-40ca-9cfd-7bbe1f3736de was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:38 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Volume volume-b939814c-ac4e-462b-9492-df4e91d8fca1 (b939814c-ac4e-462b-9492-df4e91d8fca1): created successfully Sep 28 17:07:38 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e Sep 28 17:07:38 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61588318-ab0b-42a8-a8b8-2e6856fe5a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (2fb5e4b0-e24f-4bd2-96a0-895fd0fa716b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-06e195c3-5a60-4e0a-b08f-cd5d47af6e4c tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-b939814c-ac4e-462b-9492-df4e91d8fca1-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "cinder-b939814c-ac4e-462b-9492-df4e91d8fca1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-b939814c-ac4e-462b-9492-df4e91d8fca1" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-b939814c-ac4e-462b-9492-df4e91d8fca1" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1edfe5b-09e2-47a7-9a2f-ac6929a839b0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:39 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 Sep 28 17:07:39 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:40 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1" returned: 0 in 0.716s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:40 devstack sudo[92400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1 Sep 28 17:07:40 devstack sudo[92400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:40 devstack sudo[92400]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b939814c-ac4e-462b-9492-df4e91d8fca1" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-b939814c-ac4e-462b-9492-df4e91d8fca1" released by "delete_volume" :: held 1.167s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Created reservations ['22cd16d7-bfbc-4d3f-8fbd-3d101deee305', '5561dc26-a1b3-414b-a289-2d976fa1519b', '48fbe806-5b8c-441d-8ba2-e452350ba455', '453cfdc6-d64f-4359-bde1-506e353a6d8e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:40 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:40 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-256d11c9-17d1-4a7d-ba91-8f84ebad0a9c req-dea07e1f-733f-48e8-b44d-82a67a37af77 tempest-TaggedAttachmentsTest-1580406884 None] Terminate volume connection completed successfully. Sep 28 17:07:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-256d11c9-17d1-4a7d-ba91-8f84ebad0a9c req-dea07e1f-733f-48e8-b44d-82a67a37af77 tempest-TaggedAttachmentsTest-1580406884 None] Deleting attachment 5a8ab267-2a73-4bfa-a76a-1d06b243a33f. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:07:41 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-acd38aa5-27b6-4ebe-9d25-88413574be84 tempest-VolumesGetTest-1320749060 None] Lock "cinder-b939814c-ac4e-462b-9492-df4e91d8fca1-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:41 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e" returned: 0 in 3.500s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_wowcqjeudevstack@QuobyteHD, size 112.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:07:41 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Converted 112.00 MB image at 31.99 MB/s Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-2dd49730-1b34-4ebc-88d3-3b183c3c79ea-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:41 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1G Sep 28 17:07:41 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "cinder-2dd49730-1b34-4ebc-88d3-3b183c3c79ea-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" acquired by "delete_volume" :: waited 0.076s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d7e139-1a63-4a82-b33b-ef98b8dd811f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:42 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e 1G" returned: 0 in 0.794s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Downloaded image 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume c0526e02-f2de-45db-81cf-17142824871e successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de for user ec64040e081446a7aee5f98cecaeda2c is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Marking volume c0526e02-f2de-45db-81cf-17142824871e as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Copying metadata from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de to c0526e02-f2de-45db-81cf-17142824871e. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Creating volume glance metadata for volume c0526e02-f2de-45db-81cf-17142824871e backed by image 40f838d7-edca-40ca-9cfd-7bbe1f3736de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:07:42 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea Sep 28 17:07:42 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7854b8a-8319-4d4b-b63f-7fa7fe894030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0526e02-f2de-45db-81cf-17142824871e', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f44a748-f1c7-4129-83dd-aefd25f25a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Volume volume-c0526e02-f2de-45db-81cf-17142824871e (c0526e02-f2de-45db-81cf-17142824871e): created successfully Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f44a748-f1c7-4129-83dd-aefd25f25a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Flow 'volume_create_manager' (7b42a4ce-4519-434f-9f3d-67a528d05227) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cc0d1ab8-5bde-456b-839a-2e2474f30780 tempest-ServerActionsTestOtherA-963292488 None] Created volume successfully. Sep 28 17:07:43 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" returned: 0 in 0.977s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:43 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea Sep 28 17:07:43 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:43 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" returned: 0 in 0.415s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2dd49730-1b34-4ebc-88d3-3b183c3c79ea" released by "delete_volume" :: held 1.542s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:43 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Created reservations ['49abf908-e9bf-4e82-834f-28ddc418229d', 'caf87a9b-c4b5-4990-9277-7a2070ed41ae', '575e31c6-dbd5-40b5-9adf-13754099594a', '413ac930-f1e9-434e-8060-30c0bbabda0b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:44 devstack sudo[92548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:44 devstack sudo[92548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "cinder-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:07:44 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:44 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:07:44 devstack sudo[92548]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.666s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc99197-9bc5-44ea-b8c2-d81ae762af5b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9b9f971-29ac-424a-82b7-4fae10331e80 tempest-VolumesGetTest-1320749060 None] Lock "cinder-2dd49730-1b34-4ebc-88d3-3b183c3c79ea-delete_volume" released by "delete_volume" :: held 2.885s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:45 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.576s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:45 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:07:45 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:07:45 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 1.056s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:45 devstack sudo[92566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45 Sep 28 17:07:45 devstack sudo[92566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:46 devstack sudo[92566]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45" released by "delete_volume" :: held 1.730s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Created reservations ['4f62b2c8-4b6c-449c-8d07-0399d07e61be', 'e3165dec-bb3e-4ae8-9b62-a2b106fe7a06', 'd5f21eed-5358-471f-b524-842badafd39c', 'b85f05ab-b2fc-4d79-b5ce-96ac6a872469'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:46 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:07:46 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:46 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.386s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:07:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:07:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-da38722c-da74-4b70-97ea-d40be5b24abc tempest-VolumesGetTest-1320749060 None] Lock "cinder-7fc8d6fa-11d7-4938-b987-a2fbbd3cbc45-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:07:48 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (ebf8c001-20bd-4b7c-b9cc-a7e706a2baba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2429aae4-af66-4ff0-ac8e-656cc9988ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2429aae4-af66-4ff0-ac8e-656cc9988ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1223455042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a10b00b-abfd-4f42-97fc-af3c7a08bae9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:49Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51519c7-3c71-4a0b-9e27-8d6e4440ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c51519c7-3c71-4a0b-9e27-8d6e4440ca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1871aa-94ee-4d2e-bf97-115fea2b46bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-cdfecfc2-2cd6-447c-b044-7ae6f5c6b3ac req-d2bdb22b-e944-4e0b-b394-9f0d7924cd3c tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-cdfecfc2-2cd6-447c-b044-7ae6f5c6b3ac req-d2bdb22b-e944-4e0b-b394-9f0d7924cd3c tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-cdfecfc2-2cd6-447c-b044-7ae6f5c6b3ac req-d2bdb22b-e944-4e0b-b394-9f0d7924cd3c tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-cdfecfc2-2cd6-447c-b044-7ae6f5c6b3ac req-d2bdb22b-e944-4e0b-b394-9f0d7924cd3c tempest-ServerActionsTestOtherA-963292488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-c0526e02-f2de-45db-81cf-17142824871e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '02b2158d-92f1-4fa6-a196-0b0fd3fd9558', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:07:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-cdfecfc2-2cd6-447c-b044-7ae6f5c6b3ac req-d2bdb22b-e944-4e0b-b394-9f0d7924cd3c tempest-ServerActionsTestOtherA-963292488 None] attachment_update completed successfully. Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1871aa-94ee-4d2e-bf97-115fea2b46bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a10b00b-abfd-4f42-97fc-af3c7a08bae9', 'volume_name': 'volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e26de4-1537-4fc3-9a02-a515f8b55fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e26de4-1537-4fc3-9a02-a515f8b55fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af9f1d5-ff24-4806-80f1-441aa48dceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:07:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Trying to clone 2a10b00b-abfd-4f42-97fc-af3c7a08bae9 from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de at location (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:07:50 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e6dfd8-2b11-4178-ba30-6283be10bcc1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:51 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD Sep 28 17:07:51 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:51 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:51 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de is fetched for user 17b3c02a33504254bb25b9b031faa33d. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:07:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec666c83-5a4d-4551-812e-3689708bf99e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:51 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD Sep 28 17:07:51 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:52 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1223455042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a10b00b-abfd-4f42-97fc-af3c7a08bae9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:07:49Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Creating volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:07:52 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:52 devstack sudo[92628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1073741824 Sep 28 17:07:52 devstack sudo[92628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:52 devstack sudo[92628]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1073741824" returned: 0 in 0.660s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:52 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 Sep 28 17:07:52 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:53 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" returned: 0 in 0.387s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Attempting download of 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407ade7-6951-4ea5-9520-c782377a5367]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:53 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322 Sep 28 17:07:53 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:53 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322" returned: 0 in 0.611s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:54 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322 Sep 28 17:07:54 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:54 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322" returned: 1 in 0.684s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_t5abh322' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:07:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0573dd-0c1f-4d30-bbdf-70232b67e1f5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:07:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:54 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD Sep 28 17:07:54 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:55 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:55 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] 40f838d7-edca-40ca-9cfd-7bbe1f3736de was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:07:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:55 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 Sep 28 17:07:55 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:58 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" returned: 0 in 3.594s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:58 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_pwov1ggddevstack@QuobyteHD, size 112.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:07:58 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Converted 112.00 MB image at 31.16 MB/s Sep 28 17:07:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:07:58 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1G Sep 28 17:07:58 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:07:59 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 1G" returned: 0 in 1.010s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Downloaded image 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9 successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de for user 17b3c02a33504254bb25b9b031faa33d is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Marking volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9 as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Copying metadata from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de to 2a10b00b-abfd-4f42-97fc-af3c7a08bae9. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:07:59 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Creating volume glance metadata for volume 2a10b00b-abfd-4f42-97fc-af3c7a08bae9 backed by image 40f838d7-edca-40ca-9cfd-7bbe1f3736de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af9f1d5-ff24-4806-80f1-441aa48dceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74336dd7-096a-4aba-998b-c76bc4e92254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "cinder-9dfde575-7d68-4bbd-a603-f408af1f0ad5-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:00 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Volume volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 (2a10b00b-abfd-4f42-97fc-af3c7a08bae9): created successfully Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74336dd7-096a-4aba-998b-c76bc4e92254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (ebf8c001-20bd-4b7c-b9cc-a7e706a2baba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-366463b8-7a9e-47e7-9b88-05906f5cf6d9 tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "cinder-9dfde575-7d68-4bbd-a603-f408af1f0ad5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "cinder-quobyte-9dfde575-7d68-4bbd-a603-f408af1f0ad5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "cinder-quobyte-9dfde575-7d68-4bbd-a603-f408af1f0ad5" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[231f2b61-b8ab-4115-896c-f6aa58af3f49]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 Sep 28 17:08:00 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:00 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5" returned: 0 in 0.500s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:00 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5 Sep 28 17:08:00 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9dfde575-7d68-4bbd-a603-f408af1f0ad5" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "cinder-quobyte-9dfde575-7d68-4bbd-a603-f408af1f0ad5" released by "delete_volume" :: held 1.060s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Created reservations ['b2cdeddf-bf32-4368-bef4-5cc831dd4b5e', 'e57edbad-b326-4c8f-b6c4-4bdf5e3fd23f', 'd71b79da-a99c-49ab-89dc-bedd02b0396f', '91d3eb80-b79b-4a74-aefb-ef938d83f910'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (cc08588a-8296-4169-9984-4d32888bdfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af400f-2771-46ec-a7cc-fbbf1d7fd7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0af400f-2771-46ec-a7cc-fbbf1d7fd7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1506467758',display_name='tempest-VolumesGetTest-Volume-1276076254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:01Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01303b9-138e-48b1-8c10-f862e4731b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01303b9-138e-48b1-8c10-f862e4731b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58fe73-a287-4de7-9977-f50c70ebc923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be58fe73-a287-4de7-9977-f50c70ebc923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7', 'volume_name': 'volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2d1822-d152-4ca8-91a4-e6712a96d9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e2d1822-d152-4ca8-91a4-e6712a96d9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b3fb4b-fa04-490e-ae61-f58c5211ddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Volume 8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7', 'volume_size': 1} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1506467758',display_name='tempest-VolumesGetTest-Volume-1276076254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f1e604efcb545e88a083350d8020b54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:01Z,use_quota=True,user_id='17b3c02a33504254bb25b9b031faa33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Creating volume 8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 1073741824 Sep 28 17:08:01 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:01 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:08:01 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:01 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.389s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:01 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Deleted volume successfully. Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fc0845fb-6ca9-42ff-aaa0-783cf832d4ee tempest-TaggedAttachmentsTest-1580406884 None] Lock "cinder-9dfde575-7d68-4bbd-a603-f408af1f0ad5-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:02 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 1073741824" returned: 0 in 0.769s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:02 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 Sep 28 17:08:02 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:02 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b3fb4b-fa04-490e-ae61-f58c5211ddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128602e9-0f04-4060-a85f-4537c4c669c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Volume volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 (8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7): created successfully Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (128602e9-0f04-4060-a85f-4537c4c669c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Flow 'volume_create_manager' (cc08588a-8296-4169-9984-4d32888bdfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-164bbc29-b7d2-4a4f-8338-f5a85cdae5ce tempest-VolumesGetTest-1320749060 None] Created volume successfully. Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "cinder-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbd6705-c316-436b-b1d6-fcba6a4bb6db]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[93185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 Sep 28 17:08:04 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:04 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" returned: 0 in 0.669s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:04 devstack sudo[93191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7 Sep 28 17:08:04 devstack sudo[93191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:05 devstack sudo[93191]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" returned: 0 in 0.476s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7" released by "delete_volume" :: held 1.264s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Created reservations ['45d78943-3106-4e64-b0be-66081fc65cdc', '1dd3f001-a25f-40c2-9e0c-cb4ece6cc574', '1a0464d9-b66b-424c-8d7a-220ac1d0e350', '3479f5af-72b9-41eb-91f5-5d2184cd1d5d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:05 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:08:05 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:06 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.383s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e696468-cc91-4f55-b7de-b740d238a96c tempest-VolumesGetTest-1320749060 None] Lock "cinder-8397d45d-f8ec-4ab5-a6fa-fae8ed0e4ac7-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-2a10b00b-abfd-4f42-97fc-af3c7a08bae9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "cinder-2a10b00b-abfd-4f42-97fc-af3c7a08bae9-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Acquiring lock "cinder-quobyte-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" acquired by "delete_volume" :: waited 0.067s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64fce9f-e225-4d30-a366-0f795e9c906c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:08:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 Sep 28 17:08:07 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:07 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" returned: 0 in 0.588s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:07 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9 Sep 28 17:08:07 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:08 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" returned: 0 in 0.526s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "cinder-quobyte-2a10b00b-abfd-4f42-97fc-af3c7a08bae9" released by "delete_volume" :: held 1.215s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Created reservations ['4ae22418-4d1b-4412-b120-eb0062fb4717', 'cdf3c6d6-20d3-4057-9e62-8c28b89a39e3', '97652067-9a02-4853-8c8b-81ff7de32dfa', '20a35935-55cd-49aa-ba00-e4894fc6993f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:08 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:08:08 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:09 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.770s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:09 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Deleted volume successfully. Sep 28 17:08:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eacd0f19-a00e-4b11-86a4-d63c4f5c2b41 tempest-VolumesGetTest-1320749060 None] Lock "cinder-2a10b00b-abfd-4f42-97fc-af3c7a08bae9-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (43c359e4-73ed-4aa2-956e-5fa13812204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b30151-e683-47d3-94a0-a45678dfde0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b30151-e683-47d3-94a0-a45678dfde0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-271817436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dce6956-2f86-4e24-953d-2d0988579103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:12Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed32a9d-6787-4a12-89cd-a576504a0464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed32a9d-6787-4a12-89cd-a576504a0464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de86b0ff-dd15-4769-886b-b2ad83e040c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de86b0ff-dd15-4769-886b-b2ad83e040c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dce6956-2f86-4e24-953d-2d0988579103', 'volume_name': 'volume-4dce6956-2f86-4e24-953d-2d0988579103', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae30030-f168-466b-a364-2bca079d98e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae30030-f168-466b-a364-2bca079d98e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a61a37-3a80-47d8-9ea5-c9f4a213d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:12 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Volume 4dce6956-2f86-4e24-953d-2d0988579103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dce6956-2f86-4e24-953d-2d0988579103', 'volume_size': 1} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-271817436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dce6956-2f86-4e24-953d-2d0988579103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:08:12Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Creating volume 4dce6956-2f86-4e24-953d-2d0988579103 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:08:12 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:08:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:12 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 1073741824 Sep 28 17:08:12 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:13 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 1073741824" returned: 0 in 0.977s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:13 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 Sep 28 17:08:13 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:13 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a61a37-3a80-47d8-9ea5-c9f4a213d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dce6956-2f86-4e24-953d-2d0988579103', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c472991-628c-4be8-8f65-55bc08ebd182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:08:13 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Volume volume-4dce6956-2f86-4e24-953d-2d0988579103 (4dce6956-2f86-4e24-953d-2d0988579103): created successfully Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c472991-628c-4be8-8f65-55bc08ebd182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:08:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (43c359e4-73ed-4aa2-956e-5fa13812204f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:08:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7ca3741f-01d3-4612-be4f-d9f964a54436 tempest-AttachVolumeNegativeTest-873860527 None] Created volume successfully. Sep 28 17:08:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-42984499-c896-43ab-8a08-3419ccd54d5a req-bb7346b6-6f8e-40dc-a4d9-e41651356dc0 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-42984499-c896-43ab-8a08-3419ccd54d5a req-bb7346b6-6f8e-40dc-a4d9-e41651356dc0 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-42984499-c896-43ab-8a08-3419ccd54d5a req-bb7346b6-6f8e-40dc-a4d9-e41651356dc0 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-42984499-c896-43ab-8a08-3419ccd54d5a req-bb7346b6-6f8e-40dc-a4d9-e41651356dc0 tempest-AttachVolumeNegativeTest-873860527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-4dce6956-2f86-4e24-953d-2d0988579103', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90d2063a-db77-4378-bebd-2ba54cbbd58d', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-42984499-c896-43ab-8a08-3419ccd54d5a req-bb7346b6-6f8e-40dc-a4d9-e41651356dc0 tempest-AttachVolumeNegativeTest-873860527 None] attachment_update completed successfully. Sep 28 17:08:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-9e88e1d3-9104-4b6a-9096-f92990b6b4ab tempest-ServerActionsTestOtherA-963292488 None] Terminate volume connection completed successfully. Sep 28 17:08:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-9e88e1d3-9104-4b6a-9096-f92990b6b4ab tempest-ServerActionsTestOtherA-963292488 None] Deleting attachment 02b2158d-92f1-4fa6-a196-0b0fd3fd9558. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:08:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-1345b54b-b519-4af2-a92a-45fb929f8c86 tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-1345b54b-b519-4af2-a92a-45fb929f8c86 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-1345b54b-b519-4af2-a92a-45fb929f8c86 tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-1345b54b-b519-4af2-a92a-45fb929f8c86 tempest-ServerActionsTestOtherA-963292488 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-c0526e02-f2de-45db-81cf-17142824871e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3df3d158-dcb0-42d3-a878-943381e61d8e', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:08:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-369d8dc0-9473-4b70-b39e-6b12ab11f04f req-1345b54b-b519-4af2-a92a-45fb929f8c86 tempest-ServerActionsTestOtherA-963292488 None] attachment_update completed successfully. Sep 28 17:08:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=83,cinder:UPDATE=68,cinder:INSERT=33,cinder:DELETE=6 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=82,cinder:SELECT=81,cinder:DELETE=6,cinder:INSERT=22 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:08:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:08:44 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:08:44 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:08:45 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 28 17:08:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.512s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:08:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:08:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:08:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:08:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (503426ee-c17f-44be-9ac9-b091d2b6e6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e546b764-3bf7-4f09-a988-8d3f5ca87bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e546b764-3bf7-4f09-a988-8d3f5ca87bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-864891034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:06Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e450d9-0839-46f1-857e-a45c0c3d5324),volume_type_id=65e450d9-0839-46f1-857e-a45c0c3d5324)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9660019-1c33-456e-bb6d-4b4652b8e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9660019-1c33-456e-bb6d-4b4652b8e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec67890-75fb-47b2-a627-c6ea3c39cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec67890-75fb-47b2-a627-c6ea3c39cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f', 'volume_name': 'volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305a24bd-a631-45da-9dcf-bb264d9d4d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (305a24bd-a631-45da-9dcf-bb264d9d4d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef66274-8f79-4b81-92db-d074035ca605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f', 'volume_size': 1} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-864891034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:06Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65e450d9-0839-46f1-857e-a45c0c3d5324),volume_type_id=65e450d9-0839-46f1-857e-a45c0c3d5324)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Creating volume f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:05 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:09:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:05 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f 1073741824 Sep 28 17:09:05 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (34c81fc7-29a5-4106-ad71-3343a10ddb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae6edd3-4cec-4ce4-a421-e3cf009d5008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aae6edd3-4cec-4ce4-a421-e3cf009d5008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-25356269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ec804e-2298-4bd5-9812-b197b4a72a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:06Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be52f6b-91b6-4baa-b557-01a418daa49d),volume_type_id=9be52f6b-91b6-4baa-b557-01a418daa49d)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072c4b70-4e33-4570-b690-1fc792e10ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (072c4b70-4e33-4570-b690-1fc792e10ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd31982c-d0aa-402e-9ef5-31fd4d599098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd31982c-d0aa-402e-9ef5-31fd4d599098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ec804e-2298-4bd5-9812-b197b4a72a38', 'volume_name': 'volume-03ec804e-2298-4bd5-9812-b197b4a72a38', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cefe69-a5f8-4cf6-8675-bd1f1e3c7148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0cefe69-a5f8-4cf6-8675-bd1f1e3c7148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec7d66-cbdf-408f-8d52-2dfb55194e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume 03ec804e-2298-4bd5-9812-b197b4a72a38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ec804e-2298-4bd5-9812-b197b4a72a38', 'volume_size': 1} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:06 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f 1073741824" returned: 0 in 0.745s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:06 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f Sep 28 17:09:06 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" returned: 0 in 0.413s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.574s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-25356269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03ec804e-2298-4bd5-9812-b197b4a72a38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:06Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9be52f6b-91b6-4baa-b557-01a418daa49d),volume_type_id=9be52f6b-91b6-4baa-b557-01a418daa49d)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Creating volume 03ec804e-2298-4bd5-9812-b197b4a72a38 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:07 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fef66274-8f79-4b81-92db-d074035ca605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:07 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 1073741824 Sep 28 17:09:07 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe20b75-1af6-488e-944f-8f328f1fce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f (f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f): created successfully Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe20b75-1af6-488e-944f-8f328f1fce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (503426ee-c17f-44be-9ac9-b091d2b6e6fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5687b12a-43d8-4ad7-a7a0-522c82b10f16 tempest-TestInstancesWithCinderVolumes-1677526276 None] Created volume successfully. Sep 28 17:09:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-c4139d43-e5ec-4289-8883-b0018acc301d tempest-ServerActionsTestOtherA-963292488 None] Terminate volume connection completed successfully. Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-c4139d43-e5ec-4289-8883-b0018acc301d tempest-ServerActionsTestOtherA-963292488 None] Deleting attachment 3df3d158-dcb0-42d3-a878-943381e61d8e. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (b15269e2-c9f2-400c-a2d8-9dc099925377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e2da58-0b0e-4b55-9dbf-14d83883e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e2da58-0b0e-4b55-9dbf-14d83883e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-483398364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed63afad-122a-4c56-8aaa-1bb1470c13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:08Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d63a2bd8-c83c-4c54-abeb-4bb88984da1e),volume_type_id=d63a2bd8-c83c-4c54-abeb-4bb88984da1e)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998ccd7d-2146-4ac9-b691-3a4b201c4834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998ccd7d-2146-4ac9-b691-3a4b201c4834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e6273d-7533-4a80-8387-4f3ba91c0fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:07 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "cinder-c0526e02-f2de-45db-81cf-17142824871e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-c0526e02-f2de-45db-81cf-17142824871e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "cinder-quobyte-c0526e02-f2de-45db-81cf-17142824871e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-quobyte-c0526e02-f2de-45db-81cf-17142824871e" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea70fd-7234-4ee4-8475-c8fe4a6be981]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e6273d-7533-4a80-8387-4f3ba91c0fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed63afad-122a-4c56-8aaa-1bb1470c13f3', 'volume_name': 'volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3', 'volume_size': 1, 'image_id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--744127368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7886aeadaa5e4bfbbf89737542ffee82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'created_at': datetime.datetime(2026, 9, 28, 15, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60db0d6a-46ec-4890-a703-68a78f8843b5/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0188bbe-131b-4d0d-95e2-206cef0c8dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:08 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0188bbe-131b-4d0d-95e2-206cef0c8dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7223048-e02f-45ce-9445-b00cf5c7864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume ed63afad-122a-4c56-8aaa-1bb1470c13f3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3', 'volume_size': 1, 'image_id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--744127368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7886aeadaa5e4bfbbf89737542ffee82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'created_at': datetime.datetime(2026, 9, 28, 15, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60db0d6a-46ec-4890-a703-68a78f8843b5/file', 'properties': {}}, 'image_service': } Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Trying to clone ed63afad-122a-4c56-8aaa-1bb1470c13f3 from image 60db0d6a-46ec-4890-a703-68a78f8843b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 1073741824" returned: 0 in 1.318s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:08 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 Sep 28 17:09:08 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:08 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e Sep 28 17:09:08 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:09 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e" returned: 0 in 0.837s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:09 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e Sep 28 17:09:09 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:09 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38" returned: 0 in 0.838s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec7d66-cbdf-408f-8d52-2dfb55194e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ec804e-2298-4bd5-9812-b197b4a72a38', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41e0208-59c9-44bd-802e-88c4e822b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:09 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume volume-03ec804e-2298-4bd5-9812-b197b4a72a38 (03ec804e-2298-4bd5-9812-b197b4a72a38): created successfully Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f41e0208-59c9-44bd-802e-88c4e822b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (34c81fc7-29a5-4106-ad71-3343a10ddb24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-32b81b4b-5f18-44da-a8f1-ca83ea9711fd tempest-TestInstancesWithCinderVolumes-1677526276 None] Created volume successfully. Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "cinder-931abb83-8dec-4f80-8c98-1a9f23bc4596-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:09 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-931abb83-8dec-4f80-8c98-1a9f23bc4596-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c0526e02-f2de-45db-81cf-17142824871e" returned: 0 in 0.718s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-quobyte-c0526e02-f2de-45db-81cf-17142824871e" released by "delete_volume" :: held 1.666s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "cinder-quobyte-931abb83-8dec-4f80-8c98-1a9f23bc4596" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-quobyte-931abb83-8dec-4f80-8c98-1a9f23bc4596" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.quota [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Created reservations ['6aade16e-a03f-4c7c-bca7-3a3a4dc3c95f', '24cbc105-d500-462d-b861-5c7b7dbfac0d', '9f2a627a-7279-4410-8820-4dc7287522b2', '2ea679ec-b07f-4ed3-9c60-ce5d8a564fc4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bbae23-353f-42f4-b94c-38e32dd71ebb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:10 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:09:10 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:10 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 Sep 28 17:09:10 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:10 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.438s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.manager [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Deleted volume successfully. Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-2e75fa70-eb47-4017-bc66-3a16832f68dc req-f9f74bde-196a-4dca-94ef-41c40fd6a73d tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-c0526e02-f2de-45db-81cf-17142824871e-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:10 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596" returned: 0 in 0.692s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:10 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596 Sep 28 17:09:10 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:11 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-931abb83-8dec-4f80-8c98-1a9f23bc4596" returned: 0 in 0.407s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-quobyte-931abb83-8dec-4f80-8c98-1a9f23bc4596" released by "delete_volume" :: held 1.164s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Created reservations ['ff62f46f-e1cc-4f7d-a463-0817a6af7ce7', 'a537582e-1ccd-4bc2-8ec8-51478b42733c', '31e51ad4-913d-44d6-ab0b-f31ad315edcc', 'a7f49071-5c09-4989-96e1-c300e5ba28a0'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:11 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:09:11 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:12 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.654s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:12 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Deleted volume successfully. Sep 28 17:09:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b125e9a3-69e9-43e7-997e-5380b79b6b5f tempest-ServerActionsTestOtherA-963292488 None] Lock "cinder-931abb83-8dec-4f80-8c98-1a9f23bc4596-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:09:15 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD, size 20.69 MB, duration 6.88 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:09:15 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Image download 20.69 MB at 3.01 MB/s Sep 28 17:09:15 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e543fe53-2bf8-4962-81e1-d6f6ba697c0a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:15 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD Sep 28 17:09:15 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:16 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD" returned: 0 in 0.643s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Temporary image 60db0d6a-46ec-4890-a703-68a78f8843b5 is fetched for user 927c08b9658d41e0a4e7be052da6337e. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6750d3-c193-42b6-8f47-37475e47055a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD Sep 28 17:09:16 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:16 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-483398364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed63afad-122a-4c56-8aaa-1bb1470c13f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7886aeadaa5e4bfbbf89737542ffee82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:08Z,use_quota=True,user_id='927c08b9658d41e0a4e7be052da6337e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d63a2bd8-c83c-4c54-abeb-4bb88984da1e),volume_type_id=d63a2bd8-c83c-4c54-abeb-4bb88984da1e)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Creating volume ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:16 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:09:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:16 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1073741824 Sep 28 17:09:16 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:17 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1073741824" returned: 0 in 0.961s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:18 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 Sep 28 17:09:18 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:18 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3" returned: 0 in 0.547s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Attempting download of 60db0d6a-46ec-4890-a703-68a78f8843b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}])) to volume ed63afad-122a-4c56-8aaa-1bb1470c13f3. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c51e90-f063-4c89-82a5-b3c4148eaa4a]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu Sep 28 17:09:19 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:19 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu" returned: 0 in 0.845s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:19 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu Sep 28 17:09:19 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu" returned: 1 in 0.509s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60db0d6a-46ec-4890-a703-68a78f8843b5_2ow_bggu' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f8421-ff04-42d4-b575-53f4638fec35]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD Sep 28 17:09:20 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:20 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD" returned: 0 in 0.664s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] 60db0d6a-46ec-4890-a703-68a78f8843b5 was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:09:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:20 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 Sep 28 17:09:20 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-00cd6559-73b5-4150-8834-41df10a1a759 req-e0b5866e-c697-4147-a4a9-7c1113e1390e tempest-AttachVolumeNegativeTest-873860527 None] Terminate volume connection completed successfully. Sep 28 17:09:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-00cd6559-73b5-4150-8834-41df10a1a759 req-e0b5866e-c697-4147-a4a9-7c1113e1390e tempest-AttachVolumeNegativeTest-873860527 None] Deleting attachment 90d2063a-db77-4378-bebd-2ba54cbbd58d. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:09:24 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3" returned: 0 in 3.851s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:24 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60db0d6a-46ec-4890-a703-68a78f8843b5_4s4fckemdevstack@QuobyteHD, size 112.00 MB, duration 3.85 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:09:24 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Converted 112.00 MB image at 29.07 MB/s Sep 28 17:09:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:24 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1G Sep 28 17:09:24 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:25 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 1G" returned: 0 in 0.625s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Downloaded image 60db0d6a-46ec-4890-a703-68a78f8843b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}])) to volume ed63afad-122a-4c56-8aaa-1bb1470c13f3 successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Temporary image 60db0d6a-46ec-4890-a703-68a78f8843b5 for user 927c08b9658d41e0a4e7be052da6337e is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Marking volume ed63afad-122a-4c56-8aaa-1bb1470c13f3 as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Copying metadata from image 60db0d6a-46ec-4890-a703-68a78f8843b5 to ed63afad-122a-4c56-8aaa-1bb1470c13f3. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Creating volume glance metadata for volume ed63afad-122a-4c56-8aaa-1bb1470c13f3 backed by image 60db0d6a-46ec-4890-a703-68a78f8843b5 with: {'image_id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'image_name': 'tempest-scenario-img--744127368', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7223048-e02f-45ce-9445-b00cf5c7864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3', 'volume_size': 1, 'image_id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60db0d6a-46ec-4890-a703-68a78f8843b5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--744127368', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7886aeadaa5e4bfbbf89737542ffee82', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '60db0d6a-46ec-4890-a703-68a78f8843b5', 'created_at': datetime.datetime(2026, 9, 28, 15, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 9, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60db0d6a-46ec-4890-a703-68a78f8843b5/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cd921a-0579-44e5-8a56-cc888d338aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:25 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Volume volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 (ed63afad-122a-4c56-8aaa-1bb1470c13f3): created successfully Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25cd921a-0579-44e5-8a56-cc888d338aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Flow 'volume_create_manager' (b15269e2-c9f2-400c-a2d8-9dc099925377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ee9703c2-e897-477f-9123-a0ed98f24d4c tempest-TestInstancesWithCinderVolumes-1677526276 None] Created volume successfully. Sep 28 17:09:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2a67076d-769b-4471-8bbe-35edd2b39222 req-a2b970b7-4b19-4570-89f5-3f1c1e658009 tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2a67076d-769b-4471-8bbe-35edd2b39222 req-a2b970b7-4b19-4570-89f5-3f1c1e658009 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2a67076d-769b-4471-8bbe-35edd2b39222 req-a2b970b7-4b19-4570-89f5-3f1c1e658009 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-2a67076d-769b-4471-8bbe-35edd2b39222 req-a2b970b7-4b19-4570-89f5-3f1c1e658009 tempest-TestInstancesWithCinderVolumes-1677526276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4be9b68f-4161-44a4-ada0-a1ea7524b48b', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-2a67076d-769b-4471-8bbe-35edd2b39222 req-a2b970b7-4b19-4570-89f5-3f1c1e658009 tempest-TestInstancesWithCinderVolumes-1677526276 None] attachment_update completed successfully. Sep 28 17:09:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=32,cinder:SELECT=29,cinder:INSERT=10,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=31,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=10 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:44 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:09:44 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:45 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.777s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (2f97644f-22f8-4726-aa29-97469dcbfd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d41e1-d26f-45e0-8bb2-9c59d521e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d41e1-d26f-45e0-8bb2-9c59d521e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1108750663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8875ff36-0880-4abd-9f2f-1a5b1c68e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:46Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d686e60a-c50f-4452-a6ea-b3fea1577cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d686e60a-c50f-4452-a6ea-b3fea1577cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676b3dd-cfbf-4792-8169-c173e73a5993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7676b3dd-cfbf-4792-8169-c173e73a5993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8875ff36-0880-4abd-9f2f-1a5b1c68e017', 'volume_name': 'volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b317ed-99e5-4b03-bde6-dbbb26fe2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b317ed-99e5-4b03-bde6-dbbb26fe2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d34274-1713-4e32-9b79-bc561cd5b1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:46 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Volume 8875ff36-0880-4abd-9f2f-1a5b1c68e017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017', 'volume_size': 1} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1108750663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8875ff36-0880-4abd-9f2f-1a5b1c68e017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:09:46Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Creating volume 8875ff36-0880-4abd-9f2f-1a5b1c68e017 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:09:46 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:46 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 1073741824 Sep 28 17:09:46 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:46 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 1073741824" returned: 0 in 0.756s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:09:47 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 Sep 28 17:09:47 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017" returned: 0 in 0.528s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:09:47 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6d34274-1713-4e32-9b79-bc561cd5b1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96919abd-9ce1-47e3-841c-7cc78cf7b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:09:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Volume volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 (8875ff36-0880-4abd-9f2f-1a5b1c68e017): created successfully Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96919abd-9ce1-47e3-841c-7cc78cf7b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:09:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (2f97644f-22f8-4726-aa29-97469dcbfd62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:09:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-51be0e95-51f1-4d44-af2a-bc6a0552c234 tempest-AttachVolumeTestJSON-1766129625 None] Created volume successfully. Sep 28 17:09:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f5117c8a-c3e0-410a-b62b-a7ac754e7509 req-f37991b8-5c7c-4bfb-83d0-b5fd13c8b87e tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:09:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f5117c8a-c3e0-410a-b62b-a7ac754e7509 req-f37991b8-5c7c-4bfb-83d0-b5fd13c8b87e tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:09:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f5117c8a-c3e0-410a-b62b-a7ac754e7509 req-f37991b8-5c7c-4bfb-83d0-b5fd13c8b87e tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:09:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-f5117c8a-c3e0-410a-b62b-a7ac754e7509 req-f37991b8-5c7c-4bfb-83d0-b5fd13c8b87e tempest-AttachVolumeTestJSON-1766129625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13b59a7d-dcc2-422d-a804-0d02061e5080', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:09:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-f5117c8a-c3e0-410a-b62b-a7ac754e7509 req-f37991b8-5c7c-4bfb-83d0-b5fd13c8b87e tempest-AttachVolumeTestJSON-1766129625 None] attachment_update completed successfully. Sep 28 17:09:59 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:09:59 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:10:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-5d791f0a-423d-47b7-8dd4-c92d08e64645 req-680bbd0d-20b3-4541-8df5-63dcd800c0e1 tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-5d791f0a-423d-47b7-8dd4-c92d08e64645 req-680bbd0d-20b3-4541-8df5-63dcd800c0e1 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-5d791f0a-423d-47b7-8dd4-c92d08e64645 req-680bbd0d-20b3-4541-8df5-63dcd800c0e1 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-5d791f0a-423d-47b7-8dd4-c92d08e64645 req-680bbd0d-20b3-4541-8df5-63dcd800c0e1 tempest-TestInstancesWithCinderVolumes-1677526276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb1ed5d0-fd87-42db-a004-89956756b2e9', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:10:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-5d791f0a-423d-47b7-8dd4-c92d08e64645 req-680bbd0d-20b3-4541-8df5-63dcd800c0e1 tempest-TestInstancesWithCinderVolumes-1677526276 None] attachment_update completed successfully. Sep 28 17:10:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b413d7a4-1792-4690-bf02-b3db916cb31b req-dd7d08b0-34e4-45b3-91fc-442a82d54d73 tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b413d7a4-1792-4690-bf02-b3db916cb31b req-dd7d08b0-34e4-45b3-91fc-442a82d54d73 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b413d7a4-1792-4690-bf02-b3db916cb31b req-dd7d08b0-34e4-45b3-91fc-442a82d54d73 tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-b413d7a4-1792-4690-bf02-b3db916cb31b req-dd7d08b0-34e4-45b3-91fc-442a82d54d73 tempest-TestInstancesWithCinderVolumes-1677526276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-03ec804e-2298-4bd5-9812-b197b4a72a38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65f9ee64-f464-415e-ae2a-9a50ae94541d', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:10:23 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-b413d7a4-1792-4690-bf02-b3db916cb31b req-dd7d08b0-34e4-45b3-91fc-442a82d54d73 tempest-TestInstancesWithCinderVolumes-1677526276 None] attachment_update completed successfully. Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (afc39231-8b51-4ef9-a726-d6a96a52bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72986663-eda8-40c7-91bc-f02be407ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72986663-eda8-40c7-91bc-f02be407ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-197034067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0ac097-18ee-424b-b4be-14a827641f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:25Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d273d7fd-7916-47c5-983d-d4cd194b0266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d273d7fd-7916-47c5-983d-d4cd194b0266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b83e1-605f-4080-b46e-662c44bc1811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621b83e1-605f-4080-b46e-662c44bc1811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0ac097-18ee-424b-b4be-14a827641f3e', 'volume_name': 'volume-7e0ac097-18ee-424b-b4be-14a827641f3e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af04b6ae-646e-43a6-a095-bf06e5fcef13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af04b6ae-646e-43a6-a095-bf06e5fcef13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e54031-a821-4cbc-8797-6a5fd1db73bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:25 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Volume 7e0ac097-18ee-424b-b4be-14a827641f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0ac097-18ee-424b-b4be-14a827641f3e', 'volume_size': 1} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-197034067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0ac097-18ee-424b-b4be-14a827641f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:25Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Creating volume 7e0ac097-18ee-424b-b4be-14a827641f3e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:25 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:10:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:25 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e 1073741824 Sep 28 17:10:25 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e 1073741824" returned: 0 in 0.800s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:26 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e Sep 28 17:10:26 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:26 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e54031-a821-4cbc-8797-6a5fd1db73bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0ac097-18ee-424b-b4be-14a827641f3e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f4182-d6c7-4fa1-8530-c36aceaac95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Volume volume-7e0ac097-18ee-424b-b4be-14a827641f3e (7e0ac097-18ee-424b-b4be-14a827641f3e): created successfully Sep 28 17:10:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1f4182-d6c7-4fa1-8530-c36aceaac95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (afc39231-8b51-4ef9-a726-d6a96a52bc78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7b3bc299-ca61-484f-84da-9b5f6ab37cb2 tempest-AttachVolumeNegativeTest-873860527 None] Created volume successfully. Sep 28 17:10:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bf8699e8-db1e-452c-880a-01436d1d4f4f req-80f166f7-347d-411f-9594-63f64da2df37 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bf8699e8-db1e-452c-880a-01436d1d4f4f req-80f166f7-347d-411f-9594-63f64da2df37 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bf8699e8-db1e-452c-880a-01436d1d4f4f req-80f166f7-347d-411f-9594-63f64da2df37 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bf8699e8-db1e-452c-880a-01436d1d4f4f req-80f166f7-347d-411f-9594-63f64da2df37 tempest-AttachVolumeNegativeTest-873860527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-7e0ac097-18ee-424b-b4be-14a827641f3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4ffa5abd-007f-4c2e-9def-29b6dd592f36', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:10:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-bf8699e8-db1e-452c-880a-01436d1d4f4f req-80f166f7-347d-411f-9594-63f64da2df37 tempest-AttachVolumeNegativeTest-873860527 None] attachment_update completed successfully. Sep 28 17:10:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-998e4488-4925-45fb-a1cc-d048dc7259b0 req-1ecb1e83-4ab0-418e-8aac-bc4ed746387f tempest-AttachVolumeNegativeTest-873860527 None] Terminate volume connection completed successfully. Sep 28 17:10:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-998e4488-4925-45fb-a1cc-d048dc7259b0 req-1ecb1e83-4ab0-418e-8aac-bc4ed746387f tempest-AttachVolumeNegativeTest-873860527 None] Deleting attachment 4ffa5abd-007f-4c2e-9def-29b6dd592f36. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-1f6008a4-0cdd-4cd4-8b8b-bee7931bee96 req-bde264cd-9a54-4bb7-ac56-ded6e90f889d tempest-TestInstancesWithCinderVolumes-1677526276 None] Terminate volume connection completed successfully. Sep 28 17:10:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-1f6008a4-0cdd-4cd4-8b8b-bee7931bee96 req-bde264cd-9a54-4bb7-ac56-ded6e90f889d tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleting attachment fb1ed5d0-fd87-42db-a004-89956756b2e9. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-quobyte-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b163a2-4cf5-497e-8572-f58481e667ce]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:34 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f Sep 28 17:10:34 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:35 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" returned: 0 in 0.918s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:35 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f Sep 28 17:10:35 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:36 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" returned: 0 in 0.930s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f" released by "delete_volume" :: held 1.970s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:36 devstack cinder-volume[86842]: WARNING cinder.quota [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-963610610-985174582 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-963610610-985174582, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:36 devstack cinder-volume[86842]: WARNING cinder.quota [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-963610610-985174582 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-963610610-985174582, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:36 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Created reservations ['6254c1d9-0e22-485d-869f-991167a7e614', 'ce99dd79-47ac-45c7-a7bc-8465cb18f918', 'e73821dc-803a-4450-ab12-51decd51979f', '559a82f8-7d3c-4f53-9231-c94a4bf0d546'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:37 devstack sudo[95739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:10:37 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:37 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.686s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:37 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleted volume successfully. Sep 28 17:10:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ad2f54a8-e3ad-489e-9ca4-720fa513b6fb tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-f3b3bd3a-afd9-40c5-9797-5c24a4a0d82f-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Flow 'volume_create_manager' (a1ac6e35-3879-4e90-b3bd-da6fc4d9519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d65f56-f5d6-49c1-905d-906a98e2580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d65f56-f5d6-49c1-905d-906a98e2580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1135903381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c830d066-d76b-4663-807c-9da3af65859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772c031c79c64269b33e7eb7b2e66c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:40Z,use_quota=True,user_id='302c42ae7d604bf4866d3de034c8ab6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace583ef-439f-4e02-a027-7d8c4338543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace583ef-439f-4e02-a027-7d8c4338543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24dcf82-c7ff-44e9-afa0-a0159dbadc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c24dcf82-c7ff-44e9-afa0-a0159dbadc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c830d066-d76b-4663-807c-9da3af65859b', 'volume_name': 'volume-c830d066-d76b-4663-807c-9da3af65859b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa4e3a9-c7c1-4b95-a7ff-226d26c00815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa4e3a9-c7c1-4b95-a7ff-226d26c00815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a552a0e-4015-4b2a-9da2-aa979553fbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:40 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Volume c830d066-d76b-4663-807c-9da3af65859b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c830d066-d76b-4663-807c-9da3af65859b', 'volume_size': 1} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1135903381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c830d066-d76b-4663-807c-9da3af65859b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='772c031c79c64269b33e7eb7b2e66c9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:10:40Z,use_quota=True,user_id='302c42ae7d604bf4866d3de034c8ab6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Creating volume c830d066-d76b-4663-807c-9da3af65859b {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:10:40 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:10:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:40 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b 1073741824 Sep 28 17:10:40 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:41 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b 1073741824" returned: 0 in 0.914s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:41 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b Sep 28 17:10:41 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:41 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b" returned: 0 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a552a0e-4015-4b2a-9da2-aa979553fbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c830d066-d76b-4663-807c-9da3af65859b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28727101-26f0-4dce-99d8-6a5926980583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:10:41 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Volume volume-c830d066-d76b-4663-807c-9da3af65859b (c830d066-d76b-4663-807c-9da3af65859b): created successfully Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28727101-26f0-4dce-99d8-6a5926980583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:10:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Flow 'volume_create_manager' (a1ac6e35-3879-4e90-b3bd-da6fc4d9519c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:10:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-79e59a05-bde8-429f-aa13-eecd5512a22e tempest-ServerRescueNegativeTestJSON-803860189 None] Created volume successfully. Sep 28 17:10:42 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-a5dfc528-3727-4340-9357-2b0de5c2194e req-0e71c29a-4ef2-4803-b4f8-1a4c8e3529fa tempest-TestInstancesWithCinderVolumes-1677526276 None] Terminate volume connection completed successfully. Sep 28 17:10:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-a5dfc528-3727-4340-9357-2b0de5c2194e req-0e71c29a-4ef2-4803-b4f8-1a4c8e3529fa tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleting attachment 65f9ee64-f464-415e-ae2a-9a50ae94541d. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-03ec804e-2298-4bd5-9812-b197b4a72a38-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-03ec804e-2298-4bd5-9812-b197b4a72a38-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-quobyte-03ec804e-2298-4bd5-9812-b197b4a72a38" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-03ec804e-2298-4bd5-9812-b197b4a72a38" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a673c-e06e-49f5-812f-6b73e7a47709]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:44 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:10:44 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:44 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 Sep 28 17:10:44 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.488s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:10:45 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38" returned: 0 in 0.739s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:45 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38 Sep 28 17:10:45 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:45 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-03ec804e-2298-4bd5-9812-b197b4a72a38" returned: 0 in 0.575s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-03ec804e-2298-4bd5-9812-b197b4a72a38" released by "delete_volume" :: held 1.462s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:45 devstack cinder-volume[86842]: WARNING cinder.quota [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2025216073-537069385 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2025216073-537069385, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:45 devstack cinder-volume[86842]: WARNING cinder.quota [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2025216073-537069385 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2025216073-537069385, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Created reservations ['1ddda98e-19d4-40c3-a6e0-3361fd881cfe', '1222801a-8ac6-4a2e-814e-e6747191219b', 'ebb23614-5e19-44db-95b8-fec97d5c09ac', 'cd951786-b7fd-4bd1-9049-b4ecaa5689ec'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:46 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:10:46 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:46 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.415s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleted volume successfully. Sep 28 17:10:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-42586111-c22e-4eb9-b967-021550a602df tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-03ec804e-2298-4bd5-9812-b197b4a72a38-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-9eafd08e-c54b-427b-930d-bf6c5cc5a46e req-9bf4fc53-fe86-471d-bc09-b234ac5a9318 tempest-AttachVolumeTestJSON-1766129625 None] Terminate volume connection completed successfully. Sep 28 17:10:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-9eafd08e-c54b-427b-930d-bf6c5cc5a46e req-9bf4fc53-fe86-471d-bc09-b234ac5a9318 tempest-AttachVolumeTestJSON-1766129625 None] Deleting attachment 13b59a7d-dcc2-422d-a804-0d02061e5080. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-e80feb7a-0d40-4dda-a39a-89067069cd6d req-f7713afc-9678-461a-a52b-be0c7a6ab604 tempest-TestInstancesWithCinderVolumes-1677526276 None] Terminate volume connection completed successfully. Sep 28 17:10:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-e80feb7a-0d40-4dda-a39a-89067069cd6d req-f7713afc-9678-461a-a52b-be0c7a6ab604 tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleting attachment 4be9b68f-4161-44a4-ada0-a1ea7524b48b. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-ed63afad-122a-4c56-8aaa-1bb1470c13f3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-ed63afad-122a-4c56-8aaa-1bb1470c13f3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "cinder-quobyte-ed63afad-122a-4c56-8aaa-1bb1470c13f3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-ed63afad-122a-4c56-8aaa-1bb1470c13f3" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3375fd2-dd66-40cd-be04-665dd982b518]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:10:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:57 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 Sep 28 17:10:57 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:58 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3" returned: 0 in 0.696s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:58 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3 Sep 28 17:10:58 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:58 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ed63afad-122a-4c56-8aaa-1bb1470c13f3" returned: 0 in 0.559s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-quobyte-ed63afad-122a-4c56-8aaa-1bb1470c13f3" released by "delete_volume" :: held 1.351s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:10:58 devstack cinder-volume[86842]: WARNING cinder.quota [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1938141026-578267615 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1938141026-578267615, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:58 devstack cinder-volume[86842]: WARNING cinder.quota [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1938141026-578267615 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1938141026-578267615, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Created reservations ['e2333b9e-8ba4-4ddf-a095-2d47f88e7b2e', '11913e9f-92ca-4ed6-a23a-0d6db58a00b4', 'f0dfa284-4d2a-4ba8-8d7f-f4989b567c70', 'a445e523-79af-4b9b-886d-9f3b1de3f88a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:10:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:10:59 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:10:59 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:10:59 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 28 17:10:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.924s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:10:59 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:10:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Deleted volume successfully. Sep 28 17:10:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5ea47318-5be9-4f60-a7d6-9cc56b31bf6d tempest-TestInstancesWithCinderVolumes-1677526276 None] Lock "cinder-ed63afad-122a-4c56-8aaa-1bb1470c13f3-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Acquiring lock "cinder-c830d066-d76b-4663-807c-9da3af65859b-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "cinder-c830d066-d76b-4663-807c-9da3af65859b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Acquiring lock "cinder-quobyte-c830d066-d76b-4663-807c-9da3af65859b" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "cinder-quobyte-c830d066-d76b-4663-807c-9da3af65859b" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23e439-1588-4174-8e3c-c3a919138716]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b Sep 28 17:11:05 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:05 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b" returned: 0 in 0.776s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:05 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b Sep 28 17:11:05 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c830d066-d76b-4663-807c-9da3af65859b" returned: 0 in 0.491s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "cinder-quobyte-c830d066-d76b-4663-807c-9da3af65859b" released by "delete_volume" :: held 1.394s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Created reservations ['82470d6a-571d-44c8-b73c-a56aaf0c3497', '02db4f54-71fb-4fe4-b685-4a8fdbeebd1f', '0cf4a977-9bf7-45a7-9d3d-56a88b1bed2b', 'c5b10d5a-eac3-42cf-beb2-3bc88b973ef8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:06 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:06 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:06 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.575s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:06 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Deleted volume successfully. Sep 28 17:11:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10639c60-194b-4286-842d-29d6b182d594 tempest-ServerRescueNegativeTestJSON-803860189 None] Lock "cinder-c830d066-d76b-4663-807c-9da3af65859b-delete_volume" released by "delete_volume" :: held 2.357s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:16 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=46,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:16 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=52,cinder:UPDATE=39,cinder:INSERT=7,cinder:DELETE=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:11:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d50519b0-8e93-47af-a500-f10649ff04e6 tempest-BackendsCapabilitiesAdminTestsJSON-1059237634 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1520614624023, 'free_capacity_gb': 1775.1520614624023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:11:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a6ac6355-0395-4406-88e7-74aa10fc67b1 tempest-BackendsCapabilitiesAdminTestsJSON-1059237634 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1520614624023, 'free_capacity_gb': 1775.1520614624023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (13868206-2482-499c-bba9-6c9785b852a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9d29a5-4680-490a-8913-b6f587c88b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9d29a5-4680-490a-8913-b6f587c88b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-199835753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e123eb-dd4f-40e1-8705-7fd1c5746337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:37Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eab3bb1-b0c6-4fe1-9e5d-af35f469b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eab3bb1-b0c6-4fe1-9e5d-af35f469b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a353a6b-8513-49ad-be19-8101790516be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a353a6b-8513-49ad-be19-8101790516be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e123eb-dd4f-40e1-8705-7fd1c5746337', 'volume_name': 'volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9877533-2152-4e69-a279-390c09ef4ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9877533-2152-4e69-a279-390c09ef4ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa1fad5-5c59-466e-b7a5-81d9d2b4dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:36 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Volume d6e123eb-dd4f-40e1-8705-7fd1c5746337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337', 'volume_size': 1} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-199835753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e123eb-dd4f-40e1-8705-7fd1c5746337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ee3686be5445e687e0207b52b228ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:37Z,use_quota=True,user_id='3cdb88aa72c44294b1c225c4babca19f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Creating volume d6e123eb-dd4f-40e1-8705-7fd1c5746337 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:36 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:11:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:36 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 1073741824 Sep 28 17:11:36 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:37 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 1073741824" returned: 0 in 0.633s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:37 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 Sep 28 17:11:37 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:37 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa1fad5-5c59-466e-b7a5-81d9d2b4dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43287c03-60e4-4492-966b-b1519730af0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:37 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Volume volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 (d6e123eb-dd4f-40e1-8705-7fd1c5746337): created successfully Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43287c03-60e4-4492-966b-b1519730af0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Flow 'volume_create_manager' (13868206-2482-499c-bba9-6c9785b852a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:37 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1735d7e9-3d05-4423-8347-5106bf990538 tempest-AttachVolumeNegativeTest-873860527 None] Created volume successfully. Sep 28 17:11:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6c3bc5b0-936c-4f81-b788-7a3e0e588a58 req-22592643-8f80-4e8b-a447-906c4aced4c7 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6c3bc5b0-936c-4f81-b788-7a3e0e588a58 req-22592643-8f80-4e8b-a447-906c4aced4c7 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6c3bc5b0-936c-4f81-b788-7a3e0e588a58 req-22592643-8f80-4e8b-a447-906c4aced4c7 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-6c3bc5b0-936c-4f81-b788-7a3e0e588a58 req-22592643-8f80-4e8b-a447-906c4aced4c7 tempest-AttachVolumeNegativeTest-873860527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a7bcc10-b8a2-429e-8f1f-dd56d89728df', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:11:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-6c3bc5b0-936c-4f81-b788-7a3e0e588a58 req-22592643-8f80-4e8b-a447-906c4aced4c7 tempest-AttachVolumeNegativeTest-873860527 None] attachment_update completed successfully. Sep 28 17:11:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-92fb929e-7769-4985-938c-e599a75c92a6 tempest-GroupsTest-1299319908 None] Group tempest-Group1-1668568818: creating Sep 28 17:11:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-92fb929e-7769-4985-938c-e599a75c92a6 tempest-GroupsTest-1299319908 None] Group tempest-Group1-1668568818: created successfully Sep 28 17:11:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-92fb929e-7769-4985-938c-e599a75c92a6 tempest-GroupsTest-1299319908 None] Create group completed successfully. Sep 28 17:11:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-1a154cf3-b777-42c5-a15e-7b669bfede25 req-e381308d-4aea-4a09-88be-46a24d2b3698 tempest-AttachVolumeNegativeTest-873860527 None] Terminate volume connection completed successfully. Sep 28 17:11:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-1a154cf3-b777-42c5-a15e-7b669bfede25 req-e381308d-4aea-4a09-88be-46a24d2b3698 tempest-AttachVolumeNegativeTest-873860527 None] Deleting attachment 6a7bcc10-b8a2-429e-8f1f-dd56d89728df. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:11:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-573cf1e4-7d7e-4fdc-a3b7-3b240a664bf9 tempest-GroupsTest-1299319908 None] Group tempest-Group2-872930997: creating Sep 28 17:11:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-573cf1e4-7d7e-4fdc-a3b7-3b240a664bf9 tempest-GroupsTest-1299319908 None] Group tempest-Group2-872930997: created successfully Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-573cf1e4-7d7e-4fdc-a3b7-3b240a664bf9 tempest-GroupsTest-1299319908 None] Create group completed successfully. Sep 28 17:11:44 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:44 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:44 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:11:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (358d6075-f880-47ab-9cff-5f298baf428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b0e0a-67b8-4cf3-a307-9724d1eccf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400b0e0a-67b8-4cf3-a307-9724d1eccf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-253644553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e53a23be-635b-40e2-8a8c-e130373c5339,host='devstack@QuobyteHD#QuobyteHD',id=34d3601e-a94e-4536-9e0b-785038f10f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:47Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4191d32a-cdaf-4c68-b422-6f5b057ab6af),volume_type_id=4191d32a-cdaf-4c68-b422-6f5b057ab6af)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f178ab81-fa53-49c0-a9c5-0e0c4c047319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f178ab81-fa53-49c0-a9c5-0e0c4c047319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790cd1b5-64a8-4d3d-885d-4d205dbd2bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790cd1b5-64a8-4d3d-885d-4d205dbd2bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d3601e-a94e-4536-9e0b-785038f10f4f', 'volume_name': 'volume-34d3601e-a94e-4536-9e0b-785038f10f4f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a436971a-f7a7-4be9-beaa-df50f81517ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a436971a-f7a7-4be9-beaa-df50f81517ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3764b75c-cdb8-48c6-a108-cc3da68df6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:46 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Volume 34d3601e-a94e-4536-9e0b-785038f10f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d3601e-a94e-4536-9e0b-785038f10f4f', 'volume_size': 1} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e53a23be-635b-40e2-8a8c-e130373c5339,created_at=2026-09-28T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-253644553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e53a23be-635b-40e2-8a8c-e130373c5339,host='devstack@QuobyteHD#QuobyteHD',id=34d3601e-a94e-4536-9e0b-785038f10f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:47Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4191d32a-cdaf-4c68-b422-6f5b057ab6af),volume_type_id=4191d32a-cdaf-4c68-b422-6f5b057ab6af)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Creating volume 34d3601e-a94e-4536-9e0b-785038f10f4f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:46 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:11:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:46 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f 1073741824 Sep 28 17:11:46 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:47 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f 1073741824" returned: 0 in 0.768s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:47 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f Sep 28 17:11:47 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:48 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f" returned: 0 in 0.608s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3764b75c-cdb8-48c6-a108-cc3da68df6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d3601e-a94e-4536-9e0b-785038f10f4f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd22e96-a546-45e3-aa17-ed0fe24777a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:48 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Volume volume-34d3601e-a94e-4536-9e0b-785038f10f4f (34d3601e-a94e-4536-9e0b-785038f10f4f): created successfully Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd22e96-a546-45e3-aa17-ed0fe24777a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (358d6075-f880-47ab-9cff-5f298baf428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7818928c-f8e9-4650-8837-be295e7d532d tempest-GroupsTest-1299319908 None] Created volume successfully. Sep 28 17:11:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Acquiring lock "cinder-quobyte-34d3601e-a94e-4536-9e0b-785038f10f4f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-34d3601e-a94e-4536-9e0b-785038f10f4f" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:50 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b2294e-ca5f-4317-8e5b-48beb165289b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:50 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f Sep 28 17:11:50 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f" returned: 0 in 0.756s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:51 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f Sep 28 17:11:51 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34d3601e-a94e-4536-9e0b-785038f10f4f" returned: 0 in 0.351s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:51 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-34d3601e-a94e-4536-9e0b-785038f10f4f" released by "delete_volume" :: held 1.213s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Created reservations ['049c0fa1-493e-4d7d-a438-7890c0ca0f47'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:51 devstack cinder-volume[86842]: WARNING cinder.quota [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1205092759 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1205092759, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:51 devstack cinder-volume[86842]: WARNING cinder.quota [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1205092759 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1205092759, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Created reservations ['363ae29a-5bb2-4e65-8021-f802287e2b14', '320dbc1d-4e63-47d9-b649-4fef41219861', '4c17cf8c-e583-4d6e-8ec0-fcb66a06f57b', '0686b99e-f3fe-43e4-b63d-fc17d7bae2c5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-d6e123eb-dd4f-40e1-8705-7fd1c5746337-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-d6e123eb-dd4f-40e1-8705-7fd1c5746337-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:52 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:52 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-quobyte-d6e123eb-dd4f-40e1-8705-7fd1c5746337" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-d6e123eb-dd4f-40e1-8705-7fd1c5746337" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449837f-0e0b-408f-bd62-9acea61361c8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 Sep 28 17:11:52 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:52 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.419s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dcab26ea-173d-4256-acad-7821d316f1a4 tempest-GroupsTest-1299319908 None] Delete group completed successfully. Sep 28 17:11:52 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337" returned: 0 in 0.606s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:52 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337 Sep 28 17:11:52 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:53 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d6e123eb-dd4f-40e1-8705-7fd1c5746337" returned: 0 in 0.491s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-d6e123eb-dd4f-40e1-8705-7fd1c5746337" released by "delete_volume" :: held 1.168s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Created reservations ['d2ce04de-82b7-4feb-a56f-bbed16b84ba2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Created reservations ['68803612-0993-4c7f-82f3-2f73e698efca', '5e1a19db-9a15-4a8c-94eb-4cdd9e80a550', '614398d1-8506-4f14-abfd-3ee2fd74d702', '73bf984a-ee9a-43b1-8716-1f265024601b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:53 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:53 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:53 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:53 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:53 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.507s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:53 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ea36907d-393f-41e3-8db8-5d8187e41a8c tempest-GroupsTest-1299319908 None] Delete group completed successfully. Sep 28 17:11:54 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Deleted volume successfully. Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-15644af0-4932-4a62-80b8-c46e571c21dc tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-d6e123eb-dd4f-40e1-8705-7fd1c5746337-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-7e0ac097-18ee-424b-b4be-14a827641f3e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-7e0ac097-18ee-424b-b4be-14a827641f3e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-quobyte-7e0ac097-18ee-424b-b4be-14a827641f3e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-7e0ac097-18ee-424b-b4be-14a827641f3e" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cd54e-a361-4737-984f-768ef41a989d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:54 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e Sep 28 17:11:54 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6cbb04f0-c17a-49be-ae53-66209613ac2e tempest-GroupsTest-1299319908 None] Group tempest-GroupsTest-Group-1118226449: creating Sep 28 17:11:55 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e" returned: 0 in 0.659s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6cbb04f0-c17a-49be-ae53-66209613ac2e tempest-GroupsTest-1299319908 None] Group tempest-GroupsTest-Group-1118226449: created successfully Sep 28 17:11:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6cbb04f0-c17a-49be-ae53-66209613ac2e tempest-GroupsTest-1299319908 None] Create group completed successfully. Sep 28 17:11:55 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e Sep 28 17:11:55 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:55 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7e0ac097-18ee-424b-b4be-14a827641f3e" returned: 0 in 0.366s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-7e0ac097-18ee-424b-b4be-14a827641f3e" released by "delete_volume" :: held 1.100s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Created reservations ['4a2efa18-0a95-4401-b1c3-0a86aa1a28e9', 'f8521d3e-0b94-4f69-a560-f69450a697f1', 'bee848f6-f07d-4b7e-8cd4-f435b9e5d2b5', '6fb1963d-1870-49de-a4f8-acd0057b652f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:56 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:56 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:56 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.379s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:56 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:56 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Deleted volume successfully. Sep 28 17:11:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-94b245fd-4b74-40a0-a9fd-b16c08fdd775 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-7e0ac097-18ee-424b-b4be-14a827641f3e-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-4dce6956-2f86-4e24-953d-2d0988579103-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-4dce6956-2f86-4e24-953d-2d0988579103-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "cinder-quobyte-4dce6956-2f86-4e24-953d-2d0988579103" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-4dce6956-2f86-4e24-953d-2d0988579103" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (f195ffcb-3782-4680-9b56-2defeff23299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690e7293-6ad0-4570-9122-2a348ca80fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c499ee-f566-4241-bead-051358584eb3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (690e7293-6ad0-4570-9122-2a348ca80fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587262907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42355ca3-22b2-4f65-a577-c57d7e66075d,host='devstack@QuobyteHD#QuobyteHD',id=0a96bc1d-cd9a-4921-bde7-1bc117ef539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:57Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26528c44-fdbd-4b26-9cb9-4debf8834809),volume_type_id=26528c44-fdbd-4b26-9cb9-4debf8834809)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd897ec-8b69-4214-9298-6ba8e802a8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd897ec-8b69-4214-9298-6ba8e802a8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7392ec2-030f-4fe4-9de0-cba02610a8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7392ec2-030f-4fe4-9de0-cba02610a8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a96bc1d-cd9a-4921-bde7-1bc117ef539f', 'volume_name': 'volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9c5f9-be0e-4517-ae14-669eb29e8a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff9c5f9-be0e-4517-ae14-669eb29e8a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c5fced-4882-46c8-94f4-4e4b94368425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:57 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Volume 0a96bc1d-cd9a-4921-bde7-1bc117ef539f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f', 'volume_size': 1} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42355ca3-22b2-4f65-a577-c57d7e66075d,created_at=2026-09-28T15:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-587262907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42355ca3-22b2-4f65-a577-c57d7e66075d,host='devstack@QuobyteHD#QuobyteHD',id=0a96bc1d-cd9a-4921-bde7-1bc117ef539f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:11:57Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26528c44-fdbd-4b26-9cb9-4debf8834809),volume_type_id=26528c44-fdbd-4b26-9cb9-4debf8834809)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Creating volume 0a96bc1d-cd9a-4921-bde7-1bc117ef539f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:11:57 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:11:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:57 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f 1073741824 Sep 28 17:11:57 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:57 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 Sep 28 17:11:57 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103" returned: 0 in 0.637s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103 Sep 28 17:11:58 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f 1073741824" returned: 0 in 0.700s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f Sep 28 17:11:58 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-4dce6956-2f86-4e24-953d-2d0988579103" returned: 0 in 0.463s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-quobyte-4dce6956-2f86-4e24-953d-2d0988579103" released by "delete_volume" :: held 1.223s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Created reservations ['4f6ee164-3a41-444c-9635-6c927f092483', '7b61e081-f808-43e0-a65d-26c7b626cd7f', '15db1690-2521-4f0e-828c-c43c72f15cac', 'bf7fd886-3236-4df9-b069-a8ea8f1c6836'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:11:58 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:11:58 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:11:58 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" returned: 0 in 0.529s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:11:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c5fced-4882-46c8-94f4-4e4b94368425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614905aa-2f2d-40b2-8a9e-3c20cd342908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:11:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Volume volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f (0a96bc1d-cd9a-4921-bde7-1bc117ef539f): created successfully Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614905aa-2f2d-40b2-8a9e-3c20cd342908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (f195ffcb-3782-4680-9b56-2defeff23299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:11:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5bb2a987-7590-4f92-84c4-03196c5c263e tempest-GroupsTest-1299319908 None] Created volume successfully. Sep 28 17:11:59 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.378s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:11:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Deleted volume successfully. Sep 28 17:11:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a0eb7c00-bcc9-4544-b3ad-8a1613ac8be2 tempest-AttachVolumeNegativeTest-873860527 None] Lock "cinder-4dce6956-2f86-4e24-953d-2d0988579103-delete_volume" released by "delete_volume" :: held 1.971s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (9c781b87-764a-45cc-ad77-b417c1b08521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefe562e-da5e-4ade-b875-d4c26c799e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eefe562e-da5e-4ade-b875-d4c26c799e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1310389654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42355ca3-22b2-4f65-a577-c57d7e66075d,host='devstack@QuobyteHD#QuobyteHD',id=55fc223f-2824-4cbe-827c-e71ab7b1698d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:02Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26528c44-fdbd-4b26-9cb9-4debf8834809),volume_type_id=26528c44-fdbd-4b26-9cb9-4debf8834809)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26ef2b7-d799-4e75-8c2a-0e1544f5db6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26ef2b7-d799-4e75-8c2a-0e1544f5db6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c990ec-6ede-4a40-865c-1a5fb4498aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9c990ec-6ede-4a40-865c-1a5fb4498aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fc223f-2824-4cbe-827c-e71ab7b1698d', 'volume_name': 'volume-55fc223f-2824-4cbe-827c-e71ab7b1698d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a54871a-f025-4337-995c-3621fe30d73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a54871a-f025-4337-995c-3621fe30d73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebabb93b-4f74-4e37-89c9-9e94693dafec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Volume 55fc223f-2824-4cbe-827c-e71ab7b1698d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fc223f-2824-4cbe-827c-e71ab7b1698d', 'volume_size': 1} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=42355ca3-22b2-4f65-a577-c57d7e66075d,created_at=2026-09-28T15:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1310389654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=42355ca3-22b2-4f65-a577-c57d7e66075d,host='devstack@QuobyteHD#QuobyteHD',id=55fc223f-2824-4cbe-827c-e71ab7b1698d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b277fd21740d4b093125d554756c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:02Z,use_quota=True,user_id='56f355ebd4af4ad1812649b537b49530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26528c44-fdbd-4b26-9cb9-4debf8834809),volume_type_id=26528c44-fdbd-4b26-9cb9-4debf8834809)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Creating volume 55fc223f-2824-4cbe-827c-e71ab7b1698d {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:01 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d 1073741824 Sep 28 17:12:01 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:02 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d 1073741824" returned: 0 in 1.044s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Flow 'volume_create_manager' (e1c83a44-34d0-440e-b4a0-d98c22943583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253c5a5-cf92-48ce-8b05-9a83ae5212e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9253c5a5-cf92-48ce-8b05-9a83ae5212e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655032762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fd9380-8950-46f6-8ab6-c3c6c21ca11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7cf5ff3da49179dcea4cee2715e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='e4b701ee9ff04c76b0b7cc91bab416af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573e1671-98f4-4744-8b25-6086493d8e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d Sep 28 17:12:03 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573e1671-98f4-4744-8b25-6086493d8e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859508dd-3bcb-4f64-805d-8023ab492e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859508dd-3bcb-4f64-805d-8023ab492e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7fd9380-8950-46f6-8ab6-c3c6c21ca11e', 'volume_name': 'volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7436fb6-f1c2-49fb-998a-28f0a098f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7436fb6-f1c2-49fb-998a-28f0a098f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70200cdf-12c8-42fa-afc1-90e422c99d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume e7fd9380-8950-46f6-8ab6-c3c6c21ca11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e', 'volume_size': 1} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:03 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Flow 'volume_create_manager' (57184e17-c69f-4501-bb4e-e8afd9985706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f18f7b9-10d5-45b2-9949-c2f10db6442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d" returned: 0 in 0.546s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-655032762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fd9380-8950-46f6-8ab6-c3c6c21ca11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7cf5ff3da49179dcea4cee2715e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='e4b701ee9ff04c76b0b7cc91bab416af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Creating volume e7fd9380-8950-46f6-8ab6-c3c6c21ca11e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:03 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f18f7b9-10d5-45b2-9949-c2f10db6442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1520100344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf4382-dae7-4fe3-864c-55c15d8cc6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7cf5ff3da49179dcea4cee2715e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='e4b701ee9ff04c76b0b7cc91bab416af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e 1073741824 Sep 28 17:12:03 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c5d07d-484a-480b-abb3-9311af215744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c5d07d-484a-480b-abb3-9311af215744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed82dd8-6553-4626-b589-5b4ec74e0c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed82dd8-6553-4626-b589-5b4ec74e0c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cf4382-dae7-4fe3-864c-55c15d8cc6f4', 'volume_name': 'volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5e1c15-d424-41ee-9b77-3c467dcb8e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f5e1c15-d424-41ee-9b77-3c467dcb8e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60841bf-65db-4db6-a987-60d4d6e42531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume 84cf4382-dae7-4fe3-864c-55c15d8cc6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4', 'volume_size': 1} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebabb93b-4f74-4e37-89c9-9e94693dafec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fc223f-2824-4cbe-827c-e71ab7b1698d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2168c2cf-ec18-4902-b088-930d64aa3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Volume volume-55fc223f-2824-4cbe-827c-e71ab7b1698d (55fc223f-2824-4cbe-827c-e71ab7b1698d): created successfully Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2168c2cf-ec18-4902-b088-930d64aa3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Flow 'volume_create_manager' (9c781b87-764a-45cc-ad77-b417c1b08521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-da721f98-22a9-4a56-8dfe-cbe8c6e213a3 tempest-GroupsTest-1299319908 None] Created volume successfully. Sep 28 17:12:04 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e 1073741824" returned: 0 in 0.800s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-bccb3894-93e0-49f4-8a40-ad810416d90e tempest-GroupsTest-1299319908 None] Update group completed successfully. Sep 28 17:12:04 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e Sep 28 17:12:04 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1520100344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cf4382-dae7-4fe3-864c-55c15d8cc6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f7cf5ff3da49179dcea4cee2715e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:03Z,use_quota=True,user_id='e4b701ee9ff04c76b0b7cc91bab416af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Creating volume 84cf4382-dae7-4fe3-864c-55c15d8cc6f4 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:04 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:04 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 1073741824 Sep 28 17:12:04 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70200cdf-12c8-42fa-afc1-90e422c99d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6d3d4-6d12-4144-b226-debac3b9ce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e (e7fd9380-8950-46f6-8ab6-c3c6c21ca11e): created successfully Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc6d3d4-6d12-4144-b226-debac3b9ce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Flow 'volume_create_manager' (e1c83a44-34d0-440e-b4a0-d98c22943583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9feb4c18-dc3f-48a6-a86e-b343912ed76a tempest-TestServerVolumeAttachmentScenario-1530143575 None] Created volume successfully. Sep 28 17:12:05 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 1073741824" returned: 0 in 0.811s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:05 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 Sep 28 17:12:05 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-277226ce-a3b6-400e-9a28-918f5c54fd3d tempest-GroupsTest-1299319908 None] Update group completed successfully. Sep 28 17:12:06 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" returned: 0 in 0.489s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d60841bf-65db-4db6-a987-60d4d6e42531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc28fe8e-65cb-4fb6-b423-8cdaba665445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Volume volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 (84cf4382-dae7-4fe3-864c-55c15d8cc6f4): created successfully Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc28fe8e-65cb-4fb6-b423-8cdaba665445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Flow 'volume_create_manager' (57184e17-c69f-4501-bb4e-e8afd9985706) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7db2f9be-2b78-47fd-b91d-91fda17c6218 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Created volume successfully. Sep 28 17:12:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Acquiring lock "cinder-quobyte-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a9955c-35be-42f3-8b09-b3a5a0fb62f5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f Sep 28 17:12:08 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:08 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" returned: 0 in 0.590s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:08 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f Sep 28 17:12:08 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:09 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" returned: 0 in 0.593s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-0a96bc1d-cd9a-4921-bde7-1bc117ef539f" released by "delete_volume" :: held 1.295s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Acquiring lock "cinder-quobyte-55fc223f-2824-4cbe-827c-e71ab7b1698d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-55fc223f-2824-4cbe-827c-e71ab7b1698d" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b23af-b510-4f8c-baa7-91cd83e04e0d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:09 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d Sep 28 17:12:09 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d" returned: 0 in 0.712s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:10 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d Sep 28 17:12:10 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:10 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55fc223f-2824-4cbe-827c-e71ab7b1698d" returned: 0 in 0.494s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "cinder-quobyte-55fc223f-2824-4cbe-827c-e71ab7b1698d" released by "delete_volume" :: held 1.325s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:10 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Created reservations ['8864729c-b457-46d2-b516-2174f49bff60'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:11 devstack cinder-volume[86842]: WARNING cinder.quota [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1379031773 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1379031773, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:11 devstack cinder-volume[86842]: WARNING cinder.quota [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1379031773 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1379031773, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Created reservations ['85fae936-141c-41e6-8cfe-e6d72b032c5d', '6f4d9926-45fb-4d8d-b902-0832dc723342', '420412e3-b90f-4856-bd89-6b543498eb20', '28308fd2-0071-45c3-adc8-5e94f457395a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Created reservations ['cd54b604-f176-45b2-abe8-5b9e5a4da6df', 'c4069e1a-b1bc-491a-9a99-1533a1107511', '634d6828-ec5f-428b-81d7-54b0a9311cff', '82c8c177-b3db-4d14-8001-afff8c392458'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:11 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:12:11 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:11 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.449s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:12 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-df242709-98b3-46a4-b498-ec9054ee44bd tempest-GroupsTest-1299319908 None] Delete group completed successfully. Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Flow 'volume_create_manager' (3393b320-2a08-4309-8af3-c4634849cf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22630237-9383-4c0c-9905-eeac33001bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22630237-9383-4c0c-9905-eeac33001bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-640824758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074c00bb-864d-412b-b6f3-8dc73d6c73a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f8b507af0ea46c0adbdb0995c517039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:19Z,use_quota=True,user_id='f52d89839bab457e8e007c3a46d6d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedc2a18-ba53-4ec9-b2cc-16bfab6e2eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aedc2a18-ba53-4ec9-b2cc-16bfab6e2eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71d039c-430f-48e2-ad54-adc2bd122459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71d039c-430f-48e2-ad54-adc2bd122459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074c00bb-864d-412b-b6f3-8dc73d6c73a2', 'volume_name': 'volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f90f69-dab1-4cc4-b14d-16a0031cbb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f90f69-dab1-4cc4-b14d-16a0031cbb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0baf6b-2630-4996-8b09-81a5b80a92ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Volume 074c00bb-864d-412b-b6f3-8dc73d6c73a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2', 'volume_size': 1} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-640824758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074c00bb-864d-412b-b6f3-8dc73d6c73a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8f8b507af0ea46c0adbdb0995c517039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:19Z,use_quota=True,user_id='f52d89839bab457e8e007c3a46d6d29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Creating volume 074c00bb-864d-412b-b6f3-8dc73d6c73a2 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:18 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:18 devstack sudo[97204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 1073741824 Sep 28 17:12:18 devstack sudo[97204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:19 devstack sudo[97204]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 1073741824" returned: 0 in 0.830s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:19 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 Sep 28 17:12:19 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:20 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2" returned: 0 in 0.598s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0baf6b-2630-4996-8b09-81a5b80a92ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd338e1-6980-4359-9c96-dfc0c29e4639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Volume volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 (074c00bb-864d-412b-b6f3-8dc73d6c73a2): created successfully Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd338e1-6980-4359-9c96-dfc0c29e4639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Flow 'volume_create_manager' (3393b320-2a08-4309-8af3-c4634849cf63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-bc414677-144f-46b4-876e-4797c6698353 req-3fdb295f-1f23-486d-98e8-8b30ed2b10af tempest-VolumesGetTestJSON-799815997 None] Created volume successfully. Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Acquiring lock "cinder-074c00bb-864d-412b-b6f3-8dc73d6c73a2-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "cinder-074c00bb-864d-412b-b6f3-8dc73d6c73a2-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Acquiring lock "cinder-quobyte-074c00bb-864d-412b-b6f3-8dc73d6c73a2" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "cinder-quobyte-074c00bb-864d-412b-b6f3-8dc73d6c73a2" acquired by "delete_volume" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aa5095-cb50-4f80-bef4-4aefaec9456b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:23 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 Sep 28 17:12:23 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2" returned: 0 in 0.713s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:24 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2 Sep 28 17:12:24 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:24 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-074c00bb-864d-412b-b6f3-8dc73d6c73a2" returned: 0 in 0.469s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "cinder-quobyte-074c00bb-864d-412b-b6f3-8dc73d6c73a2" released by "delete_volume" :: held 1.327s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:24 devstack cinder-volume[86842]: DEBUG cinder.quota [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Created reservations ['a1b1f2d6-02e0-459b-b6d1-fb2bdaf99e72', '29cc2f60-c2cf-47b0-b552-9b39d7533ba9', '17a83590-2146-4cdf-a55c-595a498eb8c0', '3aa93701-d459-4d27-a45d-0a1df66ea5b6'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:25 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:12:25 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:25 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.612s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG cinder.manager [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Deleted volume successfully. Sep 28 17:12:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-a631c845-69e1-4e94-850c-eabbe300c45f req-8a9928ca-51eb-4754-8b42-b84d92366e27 tempest-VolumesGetTestJSON-799815997 None] Lock "cinder-074c00bb-864d-412b-b6f3-8dc73d6c73a2-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:12:27 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=89,cinder:UPDATE=81,cinder:DELETE=7,cinder:INSERT=18 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-80f82778-d053-4650-acbe-46c6053d661a tempest-GroupsV320Test-1852120088 None] Group tempest-GroupsV320Test-Group-2137145878: creating Sep 28 17:12:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-80f82778-d053-4650-acbe-46c6053d661a tempest-GroupsV320Test-1852120088 None] Group tempest-GroupsV320Test-Group-2137145878: created successfully Sep 28 17:12:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-80f82778-d053-4650-acbe-46c6053d661a tempest-GroupsV320Test-1852120088 None] Create group completed successfully. Sep 28 17:12:29 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Created reservations ['c4f69f69-18a6-4e69-9ccf-b6915db16768'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:30 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:12:30 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:30 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.458s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:30 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d0ffee76-e205-433d-b5b7-2b502151f595 tempest-GroupsV320Test-1852120088 None] Delete group completed successfully. Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=106,cinder:INSERT=20,cinder:SELECT=76,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (9f58df9a-0947-4b20-9e16-3e111088885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56ff5fa-4700-42c4-9732-188738c4cb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a56ff5fa-4700-42c4-9732-188738c4cb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776039625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66816b2-c333-4544-8469-d9f4ab011bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:40Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8294df-1a9d-40db-a151-b24254c91f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8294df-1a9d-40db-a151-b24254c91f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5a8c22-fa6b-43d8-b951-55df2a1a97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5a8c22-fa6b-43d8-b951-55df2a1a97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66816b2-c333-4544-8469-d9f4ab011bd1', 'volume_name': 'volume-a66816b2-c333-4544-8469-d9f4ab011bd1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad9888f-2a47-440a-91fa-4f12a6e5a978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad9888f-2a47-440a-91fa-4f12a6e5a978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d028ea-bbbf-4fd6-8223-16ca93c577eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:39 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Volume a66816b2-c333-4544-8469-d9f4ab011bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66816b2-c333-4544-8469-d9f4ab011bd1', 'volume_size': 1} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-776039625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66816b2-c333-4544-8469-d9f4ab011bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:40Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Creating volume a66816b2-c333-4544-8469-d9f4ab011bd1 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:39 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:39 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 1073741824 Sep 28 17:12:39 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 1073741824" returned: 0 in 0.794s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:40 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 Sep 28 17:12:40 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-19e1a985-a114-470e-9740-f7524a90da57 tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-2088923548: creating Sep 28 17:12:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-19e1a985-a114-470e-9740-f7524a90da57 tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-2088923548: created successfully Sep 28 17:12:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-19e1a985-a114-470e-9740-f7524a90da57 tempest-GroupSnapshotsTest-2085416411 None] Create group completed successfully. Sep 28 17:12:40 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04d028ea-bbbf-4fd6-8223-16ca93c577eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66816b2-c333-4544-8469-d9f4ab011bd1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ac4200-b641-4335-a77e-cebdafbc2cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:41 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Volume volume-a66816b2-c333-4544-8469-d9f4ab011bd1 (a66816b2-c333-4544-8469-d9f4ab011bd1): created successfully Sep 28 17:12:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ac4200-b641-4335-a77e-cebdafbc2cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (9f58df9a-0947-4b20-9e16-3e111088885f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-54ff76cc-6c92-4128-bf58-b488512c1fa7 tempest-AttachVolumeTestJSON-1766129625 None] Created volume successfully. Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (fc43b398-dfa8-47ec-b533-8a0ba8942009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f192ef9a-b246-4bc4-9d2c-9a5f7a0a53a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f192ef9a-b246-4bc4-9d2c-9a5f7a0a53a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349226608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4273620-2dbe-4939-887d-9acf237e113f,host='devstack@QuobyteHD#QuobyteHD',id=8c0fc051-19e6-407d-ae83-a50c0298e490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:43Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d850b3f-88e9-4b60-bc90-90cd6097d193),volume_type_id=2d850b3f-88e9-4b60-bc90-90cd6097d193)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514bf647-17cb-4be6-b48c-2ff1dec97dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (514bf647-17cb-4be6-b48c-2ff1dec97dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e09aa75-8fae-4261-a34a-6ebe8f2cc7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e09aa75-8fae-4261-a34a-6ebe8f2cc7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c0fc051-19e6-407d-ae83-a50c0298e490', 'volume_name': 'volume-8c0fc051-19e6-407d-ae83-a50c0298e490', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5391da-f64f-44d5-a1d9-e7696bc18b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5391da-f64f-44d5-a1d9-e7696bc18b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d001a94-804c-4c9e-b85b-c4af94e0d804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:42 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Volume 8c0fc051-19e6-407d-ae83-a50c0298e490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c0fc051-19e6-407d-ae83-a50c0298e490', 'volume_size': 1} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e4273620-2dbe-4939-887d-9acf237e113f,created_at=2026-09-28T15:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-349226608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e4273620-2dbe-4939-887d-9acf237e113f,host='devstack@QuobyteHD#QuobyteHD',id=8c0fc051-19e6-407d-ae83-a50c0298e490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:43Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d850b3f-88e9-4b60-bc90-90cd6097d193),volume_type_id=2d850b3f-88e9-4b60-bc90-90cd6097d193)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Creating volume 8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:43 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 1073741824 Sep 28 17:12:43 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-8dbd6ab9-e266-4e5a-b01f-72aacb343b65 req-a36ae4aa-6311-43e9-b188-a166463d91bf tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:43 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 1073741824" returned: 0 in 0.659s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:43 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:12:43 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.426s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-8dbd6ab9-e266-4e5a-b01f-72aacb343b65 req-a36ae4aa-6311-43e9-b188-a166463d91bf tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.836s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d001a94-804c-4c9e-b85b-c4af94e0d804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c0fc051-19e6-407d-ae83-a50c0298e490', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0fbe46-1328-4841-916e-84ed9046479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-8dbd6ab9-e266-4e5a-b01f-72aacb343b65 req-a36ae4aa-6311-43e9-b188-a166463d91bf tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:44 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Volume volume-8c0fc051-19e6-407d-ae83-a50c0298e490 (8c0fc051-19e6-407d-ae83-a50c0298e490): created successfully Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0fbe46-1328-4841-916e-84ed9046479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (fc43b398-dfa8-47ec-b533-8a0ba8942009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2670c7d7-e4b4-42fe-8fb0-128ad960f424 tempest-GroupSnapshotsTest-2085416411 None] Created volume successfully. Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-8dbd6ab9-e266-4e5a-b01f-72aacb343b65 req-a36ae4aa-6311-43e9-b188-a166463d91bf tempest-AttachVolumeTestJSON-1766129625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-a66816b2-c333-4544-8469-d9f4ab011bd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59dea329-8bb3-482b-98a9-0df36778130d', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:12:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-8dbd6ab9-e266-4e5a-b01f-72aacb343b65 req-a36ae4aa-6311-43e9-b188-a166463d91bf tempest-AttachVolumeTestJSON-1766129625 None] attachment_update completed successfully. Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:44 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:12:44 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:44 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:12:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:12:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] GroupSnapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: creating. Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Group snapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: creating. {{(pid=86842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Creating offline snapshot 3b76c643-de65-4ef0-87ef-f7133b58ce04 of volume 8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f57fc1a-a249-423f-a1aa-850f6b863777]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:46 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:12:46 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:46 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.674s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:46 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 1G Sep 28 17:12:46 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:47 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 1G" returned: 0 in 0.820s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0fc051-19e6-407d-ae83-a50c0298e490 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:47 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0fc051-19e6-407d-ae83-a50c0298e490 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:12:47 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (19e41354-3e79-4e71-9635-9b2ebec0515a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1388b73a-3a23-4e95-af8d-db2233cee84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1388b73a-3a23-4e95-af8d-db2233cee84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1322959849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc52009-679e-4cd8-8aed-1456d7f73c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:47Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b6bd1-384c-45d4-9185-7c2fdf04e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b6bd1-384c-45d4-9185-7c2fdf04e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c930ea-7c15-4612-bc18-14aeb4003050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c930ea-7c15-4612-bc18-14aeb4003050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc52009-679e-4cd8-8aed-1456d7f73c17', 'volume_name': 'volume-0bc52009-679e-4cd8-8aed-1456d7f73c17', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d15798-f57a-46df-93d7-42320ed1ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d15798-f57a-46df-93d7-42320ed1ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6369c63-2cbc-4aec-9525-acf9c2aed6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Volume 0bc52009-679e-4cd8-8aed-1456d7f73c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc52009-679e-4cd8-8aed-1456d7f73c17', 'volume_size': 1} Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:47 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c0fc051-19e6-407d-ae83-a50c0298e490 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.512s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:47 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:12:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:47 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:12:47 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:48 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.340s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:48 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info Sep 28 17:12:48 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:48 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info" returned: 0 in 0.368s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:48 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:12:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:48 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info Sep 28 17:12:48 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.info" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.359s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1322959849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc52009-679e-4cd8-8aed-1456d7f73c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b38e0ad5c9a464c8529091c6f2055e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:12:47Z,use_quota=True,user_id='b4f1edea0a36419ab2ef5eaf161b8fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Creating volume 0bc52009-679e-4cd8-8aed-1456d7f73c17 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:49 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 1073741824 Sep 28 17:12:49 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-23008b07-691a-4ca4-8bb2-a3a8af790b62 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: created successfully Sep 28 17:12:49 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 1073741824" returned: 0 in 0.639s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:49 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 Sep 28 17:12:49 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:50 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6369c63-2cbc-4aec-9525-acf9c2aed6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc52009-679e-4cd8-8aed-1456d7f73c17', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef80630d-d001-42f1-8e44-0125515069d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:12:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Volume volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 (0bc52009-679e-4cd8-8aed-1456d7f73c17): created successfully Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef80630d-d001-42f1-8e44-0125515069d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Flow 'volume_create_manager' (19e41354-3e79-4e71-9635-9b2ebec0515a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:12:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2fea9c67-fc54-40d7-98de-729af9bb26cb tempest-AttachVolumeTestJSON-1766129625 None] Created volume successfully. Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-06bb72d9-a13c-4e1f-b324-462e7cc4f8e0 req-2f30fe81-3759-4152-899f-2afe0d828f3c tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-06bb72d9-a13c-4e1f-b324-462e7cc4f8e0 req-2f30fe81-3759-4152-899f-2afe0d828f3c tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-06bb72d9-a13c-4e1f-b324-462e7cc4f8e0 req-2f30fe81-3759-4152-899f-2afe0d828f3c tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-06bb72d9-a13c-4e1f-b324-462e7cc4f8e0 req-2f30fe81-3759-4152-899f-2afe0d828f3c tempest-TestServerVolumeAttachmentScenario-1530143575 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3e26403a-1893-40d5-9eea-45a7ad4b3fbc', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:12:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-06bb72d9-a13c-4e1f-b324-462e7cc4f8e0 req-2f30fe81-3759-4152-899f-2afe0d828f3c tempest-TestServerVolumeAttachmentScenario-1530143575 None] attachment_update completed successfully. Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Creating volume 5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d from snapshot 3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] snapshot: 3b76c643-de65-4ef0-87ef-f7133b58ce04, volume: 5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5807dfd-7b9b-499b-8359-5e48337bb159]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:51 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:12:51 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:52 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.719s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c0fc051-19e6-407d-ae83-a50c0298e490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce4574e-09ad-431a-bcd2-0f6e503c7b6f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ff91ed54-e9f8-485c-a566-493a096c972f req-16106bcc-76c0-44fa-96d5-8b1f4e7a21e2 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:12:52 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:12:52 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:12:52 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.504s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:12:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:12:52 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d Sep 28 17:12:52 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" returned: 0 in 7.670s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:13:00 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Converted 1024.00 MB image at 133.48 MB/s Sep 28 17:13:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:00 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d Sep 28 17:13:00 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:00 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" returned: 0 in 0.259s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" released by "_copy_volume_from_snapshot" :: held 9.337s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" released by "_create_volume_from_snapshot" :: held 9.441s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.472s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ff91ed54-e9f8-485c-a566-493a096c972f req-16106bcc-76c0-44fa-96d5-8b1f4e7a21e2 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.438s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ff91ed54-e9f8-485c-a566-493a096c972f req-16106bcc-76c0-44fa-96d5-8b1f4e7a21e2 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ff91ed54-e9f8-485c-a566-493a096c972f req-16106bcc-76c0-44fa-96d5-8b1f4e7a21e2 tempest-AttachVolumeTestJSON-1766129625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-0bc52009-679e-4cd8-8aed-1456d7f73c17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89688fc1-e282-4d2d-8cce-15ca60c08024', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:13:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-345763ed-4295-4a3f-b49e-68c82aae5616 tempest-GroupSnapshotsTest-2085416411 None] Create group from source-snapshot-a5f89b2f-879d-4fc9-9851-4f946400c05c completed successfully. Sep 28 17:13:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-ff91ed54-e9f8-485c-a566-493a096c972f req-16106bcc-76c0-44fa-96d5-8b1f4e7a21e2 tempest-AttachVolumeTestJSON-1766129625 None] attachment_update completed successfully. Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-56ee7419-5fef-4c41-8f5d-4b3b4936dc97 req-8a09ee74-668d-4417-8ee9-5a800aabe117 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-56ee7419-5fef-4c41-8f5d-4b3b4936dc97 req-8a09ee74-668d-4417-8ee9-5a800aabe117 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-56ee7419-5fef-4c41-8f5d-4b3b4936dc97 req-8a09ee74-668d-4417-8ee9-5a800aabe117 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-56ee7419-5fef-4c41-8f5d-4b3b4936dc97 req-8a09ee74-668d-4417-8ee9-5a800aabe117 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a07b4ca-8f8d-47e0-a58e-71b3d6cc472b', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Flow 'volume_create_manager' (d2862aa1-3db4-4862-a6a2-2a635ca1e949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd97d3aa-0355-494f-acd7-2ff63f93a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd97d3aa-0355-494f-acd7-2ff63f93a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-966285513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8accb460-aa5f-4594-9754-b602df2cdbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1262f09d3eda4fd8870d6b7394466cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='669c1d4b4814424d91c3f13582352c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476a1ed-f3da-464a-9347-a33820208eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b476a1ed-f3da-464a-9347-a33820208eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4124aa-72c3-4fd1-8fc1-fbde6057ae9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4124aa-72c3-4fd1-8fc1-fbde6057ae9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8accb460-aa5f-4594-9754-b602df2cdbd3', 'volume_name': 'volume-8accb460-aa5f-4594-9754-b602df2cdbd3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0dc95c-845e-410f-ae9b-4dda54e9759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa0dc95c-845e-410f-ae9b-4dda54e9759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf7014f-8c42-4ecd-9838-456a33f17875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume 8accb460-aa5f-4594-9754-b602df2cdbd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8accb460-aa5f-4594-9754-b602df2cdbd3', 'volume_size': 1} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-966285513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8accb460-aa5f-4594-9754-b602df2cdbd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1262f09d3eda4fd8870d6b7394466cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:03Z,use_quota=True,user_id='669c1d4b4814424d91c3f13582352c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Creating volume 8accb460-aa5f-4594-9754-b602df2cdbd3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:02 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:02 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 1073741824 Sep 28 17:13:02 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-56ee7419-5fef-4c41-8f5d-4b3b4936dc97 req-8a09ee74-668d-4417-8ee9-5a800aabe117 tempest-TestServerVolumeAttachmentScenario-1530143575 None] attachment_update completed successfully. Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc399ef-c608-459b-8146-2a5636d64569]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d Sep 28 17:13:03 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 1073741824" returned: 0 in 0.816s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" returned: 0 in 0.720s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:03 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d Sep 28 17:13:03 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:03 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 Sep 28 17:13:03 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3" returned: 0 in 0.396s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:04 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf7014f-8c42-4ecd-9838-456a33f17875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8accb460-aa5f-4594-9754-b602df2cdbd3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa081e-09a4-4e04-838c-eb20178e67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-5ba59eb3-8ebb-4fc2-b2a3-8892ac244a0d" released by "delete_volume" :: held 1.259s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume volume-8accb460-aa5f-4594-9754-b602df2cdbd3 (8accb460-aa5f-4594-9754-b602df2cdbd3): created successfully Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fa081e-09a4-4e04-838c-eb20178e67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Flow 'volume_create_manager' (d2862aa1-3db4-4862-a6a2-2a635ca1e949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b4fb89d1-5a31-4415-abdb-70c326b32616 tempest-VolumeQuotasAdminTestJSON-1555278413 None] Created volume successfully. Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['28337589-ecff-48b0-abdf-d2c53873ddd1'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:04 devstack cinder-volume[86842]: WARNING cinder.quota [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-384857202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-384857202, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:04 devstack cinder-volume[86842]: WARNING cinder.quota [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-384857202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-384857202, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['ef8ea1ba-0ec0-4034-a2c9-c20412392f25', 'd408d201-1819-44f6-8225-a357686ca201', '8db13aba-8c51-4e23-9b56-bc079bbf01b3', '91cea33a-3fe6-4aa5-a730-4a977ab88b25'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:04 devstack sudo[98039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:04 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-c2747816-b64f-4863-a1fb-22b5dbb41817 req-84c65324-950b-4e3a-93d9-41b0d0a37e01 tempest-AttachVolumeTestJSON-1766129625 None] Terminate volume connection completed successfully. Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-c2747816-b64f-4863-a1fb-22b5dbb41817 req-84c65324-950b-4e3a-93d9-41b0d0a37e01 tempest-AttachVolumeTestJSON-1766129625 None] Deleting attachment 59dea329-8bb3-482b-98a9-0df36778130d. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:13:04 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.343s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f12b1836-2594-4b5a-b4ba-a8de6f4ada84 tempest-GroupSnapshotsTest-2085416411 None] Delete group completed successfully. Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "cinder-8accb460-aa5f-4594-9754-b602df2cdbd3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "cinder-8accb460-aa5f-4594-9754-b602df2cdbd3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "cinder-quobyte-8accb460-aa5f-4594-9754-b602df2cdbd3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "cinder-quobyte-8accb460-aa5f-4594-9754-b602df2cdbd3" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[243be33e-6bbc-4785-975a-96b9fca20d34]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[98046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 Sep 28 17:13:05 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: deleting Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: deleting {{(pid=86842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Deleting offline snapshot 3b76c643-de65-4ef0-87ef-f7133b58ce04 of volume 8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] snapshot_file for this snap is: volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab19200-5034-4bac-afbf-debbf170163d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-63d0008b-521f-4f1e-9b19-a8376428d97f req-a22cafc6-0c19-42d6-b7d8-a56694059065 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Terminate volume connection completed successfully. Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-63d0008b-521f-4f1e-9b19-a8376428d97f req-a22cafc6-0c19-42d6-b7d8-a56694059065 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Deleting attachment 7a07b4ca-8f8d-47e0-a58e-71b3d6cc472b. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:13:05 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3" returned: 0 in 0.556s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:05 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3 Sep 28 17:13:05 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:13:06 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8accb460-aa5f-4594-9754-b602df2cdbd3" returned: 0 in 0.490s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.584s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c0fc051-19e6-407d-ae83-a50c0298e490(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "cinder-quobyte-8accb460-aa5f-4594-9754-b602df2cdbd3" released by "delete_volume" :: held 1.148s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[749932dc-0885-4bc8-afbf-9ff72974f72d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Created reservations ['7246b6ee-1646-4640-a431-e4bed2b59d41', 'ec2868ab-f2c7-497c-9e7b-8c5d5a9ccdaf', '173d9f24-1319-4523-9284-355334ecc3a9', 'f6300d74-a56f-4f22-becb-03f7006680d7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:06 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:13:06 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:06 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:06 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-9fa02220-b527-4efd-b32a-001ce944a6f4 req-cf448534-f4f7-4e35-8659-688c51486b3a tempest-AttachVolumeTestJSON-1766129625 None] Terminate volume connection completed successfully. Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-9fa02220-b527-4efd-b32a-001ce944a6f4 req-cf448534-f4f7-4e35-8659-688c51486b3a tempest-AttachVolumeTestJSON-1766129625 None] Deleting attachment 89688fc1-e282-4d2d-8cce-15ca60c08024. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:13:06 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.326s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Deleted volume successfully. Sep 28 17:13:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-191f758c-1e39-4fe7-b343-18508ab9de5c tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "cinder-8accb460-aa5f-4594-9754-b602df2cdbd3-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:07 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.658s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:13:07 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.483s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:07 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04 Sep 28 17:13:07 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:07 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490.3b76c643-de65-4ef0-87ef-f7133b58ce04" returned: 0 in 0.385s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-3b76c643-de65-4ef0-87ef-f7133b58ce04" released by "_delete_snapshot" :: held 2.298s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" released by "delete_snapshot" :: held 2.355s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:08 devstack cinder-volume[86842]: WARNING cinder.quota [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-384857202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-384857202, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['f8fe6b57-dd55-4fd8-b5b3-5e7f66a71e9b', 'a47cb84b-ae31-4bc3-b2cc-d71ee9dd5b2a', 'a40a1975-16b3-45d2-8e50-fcce28a9b38e', 'e3ee97d2-3acd-4fb7-898a-3fc7e5f24e76'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Flow 'volume_create_manager' (aa0a131c-42bf-43e4-8107-3d28717c8935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8503e334-dd2a-43ff-9e70-7ea19cde3da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8503e334-dd2a-43ff-9e70-7ea19cde3da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1641469525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4949eb-d2e5-42eb-a805-b9cad17450de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1262f09d3eda4fd8870d6b7394466cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:08Z,use_quota=True,user_id='669c1d4b4814424d91c3f13582352c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820da192-1320-4c9e-afee-3b84d8f93678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (820da192-1320-4c9e-afee-3b84d8f93678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66155a89-2508-4ac1-93fe-00698cacc9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66155a89-2508-4ac1-93fe-00698cacc9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af4949eb-d2e5-42eb-a805-b9cad17450de', 'volume_name': 'volume-af4949eb-d2e5-42eb-a805-b9cad17450de', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467cf8f0-ffa8-4bd3-a3eb-3ec029e19f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (467cf8f0-ffa8-4bd3-a3eb-3ec029e19f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24379511-2510-40ca-9efd-6d166ffaf208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume af4949eb-d2e5-42eb-a805-b9cad17450de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af4949eb-d2e5-42eb-a805-b9cad17450de', 'volume_size': 1} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1641469525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af4949eb-d2e5-42eb-a805-b9cad17450de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1262f09d3eda4fd8870d6b7394466cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:08Z,use_quota=True,user_id='669c1d4b4814424d91c3f13582352c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Creating volume af4949eb-d2e5-42eb-a805-b9cad17450de {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:08 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8bd055c3-fd4e-4144-97c6-40fa492e6da7 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a5f89b2f-879d-4fc9-9851-4f946400c05c: deleted successfully Sep 28 17:13:08 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de 1073741824 Sep 28 17:13:08 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-014e5d4b-2000-46e8-a6cc-606890cb9a14 req-551b10cd-1f75-4989-b824-9bdf37b704e4 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Terminate volume connection completed successfully. Sep 28 17:13:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-014e5d4b-2000-46e8-a6cc-606890cb9a14 req-551b10cd-1f75-4989-b824-9bdf37b704e4 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Deleting attachment 3e26403a-1893-40d5-9eea-45a7ad4b3fbc. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:13:09 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de 1073741824" returned: 0 in 0.813s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:09 devstack sudo[98101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de Sep 28 17:13:09 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:09 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24379511-2510-40ca-9efd-6d166ffaf208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af4949eb-d2e5-42eb-a805-b9cad17450de', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44871376-1a16-4359-9f57-80cc94e45ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Volume volume-af4949eb-d2e5-42eb-a805-b9cad17450de (af4949eb-d2e5-42eb-a805-b9cad17450de): created successfully Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44871376-1a16-4359-9f57-80cc94e45ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Flow 'volume_create_manager' (aa0a131c-42bf-43e4-8107-3d28717c8935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5edee79e-f7eb-4ff5-98fe-67ce0962bdac tempest-VolumeQuotasAdminTestJSON-1555278413 None] Created volume successfully. Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" acquired by "delete_volume" :: waited 0.059s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06999c-53f3-4b66-8c65-733544665f43]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:10 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:13:10 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:11 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.885s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:11 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490 Sep 28 17:13:11 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:11 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c0fc051-19e6-407d-ae83-a50c0298e490" returned: 0 in 0.797s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-8c0fc051-19e6-407d-ae83-a50c0298e490" released by "delete_volume" :: held 1.834s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c586c438-ca29-4060-a95e-8b33ffca94a6 tempest-VolumeQuotasAdminTestJSON-1925037767 None] Transfer volume completed successfully. Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['b08383d9-fec4-462d-a8ab-128acc72ab9e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:12 devstack cinder-volume[86842]: WARNING cinder.db.api [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-384857202'] Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['2f2ecf95-2005-4913-bbc6-179985388583', '761ec618-2ea2-4b71-9940-9d5df3ae5793', 'bc78c572-b99b-438b-ae6a-46d11e3021a0', 'ca2ffe99-85da-47f7-808f-06d5f3c0f6d2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:12 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:12 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.687s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Acquiring lock "cinder-af4949eb-d2e5-42eb-a805-b9cad17450de-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-07d1d10e-411f-4608-95ec-5f3ef9c96c09 tempest-GroupSnapshotsTest-2085416411 None] Delete group completed successfully. Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "cinder-af4949eb-d2e5-42eb-a805-b9cad17450de-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Acquiring lock "cinder-quobyte-af4949eb-d2e5-42eb-a805-b9cad17450de" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "cinder-quobyte-af4949eb-d2e5-42eb-a805-b9cad17450de" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd8934a-c5de-4873-acb9-dda0d93957f5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:13 devstack sudo[98163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de Sep 28 17:13:13 devstack sudo[98163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-98af86ae-ef69-4579-9fd6-b05ea34a49cc tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-262074191: creating Sep 28 17:13:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-98af86ae-ef69-4579-9fd6-b05ea34a49cc tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-262074191: created successfully Sep 28 17:13:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-98af86ae-ef69-4579-9fd6-b05ea34a49cc tempest-GroupSnapshotsTest-2085416411 None] Create group completed successfully. Sep 28 17:13:14 devstack sudo[98163]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de" returned: 0 in 0.725s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:14 devstack sudo[98172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de Sep 28 17:13:14 devstack sudo[98172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:14 devstack sudo[98172]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-af4949eb-d2e5-42eb-a805-b9cad17450de" returned: 0 in 0.457s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "cinder-quobyte-af4949eb-d2e5-42eb-a805-b9cad17450de" released by "delete_volume" :: held 1.297s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Created reservations ['be8b7501-5e97-42fa-b0e1-b0bed2c6c5cb', '5ad54ec4-2b42-4900-a399-bbade5d3874a', '9519b879-11ce-4353-b8f7-9472003ca8a4', '63d5ad59-1a99-4756-b639-69f7c0191111'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:15 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:15 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:15 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.383s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Deleted volume successfully. Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-02d4eed0-7529-4438-9b18-5b18309d8db3 tempest-VolumeQuotasAdminTestJSON-1272234431 None] Lock "cinder-af4949eb-d2e5-42eb-a805-b9cad17450de-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-0bc52009-679e-4cd8-8aed-1456d7f73c17-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-0bc52009-679e-4cd8-8aed-1456d7f73c17-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-quobyte-0bc52009-679e-4cd8-8aed-1456d7f73c17" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-0bc52009-679e-4cd8-8aed-1456d7f73c17" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:15 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (a190cd8d-ad15-4b46-8dac-6e4fdc9a3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa72c0-f797-4da2-8a28-df6c6a829891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[714cdb6f-d236-4778-be28-e7db892cbfcb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34fa72c0-f797-4da2-8a28-df6c6a829891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29612237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058d38fa-9110-4386-8524-cc9148524731,host='devstack@QuobyteHD#QuobyteHD',id=1644586f-ff5b-4b2b-a8a5-f31492076721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:16Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d57f315-cbe2-4d99-983e-1a883eb4d34f),volume_type_id=7d57f315-cbe2-4d99-983e-1a883eb4d34f)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f185c5-1556-4162-bfd2-8a9e9b30623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f185c5-1556-4162-bfd2-8a9e9b30623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0f47e0-0ca4-4cba-843e-1cd3dcb1c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0f47e0-0ca4-4cba-843e-1cd3dcb1c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1644586f-ff5b-4b2b-a8a5-f31492076721', 'volume_name': 'volume-1644586f-ff5b-4b2b-a8a5-f31492076721', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a73b4e1-1489-400b-bc20-c87987f9af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a73b4e1-1489-400b-bc20-c87987f9af3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598d622c-0618-4ee4-9fc6-77b0148c9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Volume 1644586f-ff5b-4b2b-a8a5-f31492076721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1644586f-ff5b-4b2b-a8a5-f31492076721', 'volume_size': 1} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=058d38fa-9110-4386-8524-cc9148524731,created_at=2026-09-28T15:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29612237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058d38fa-9110-4386-8524-cc9148524731,host='devstack@QuobyteHD#QuobyteHD',id=1644586f-ff5b-4b2b-a8a5-f31492076721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:16Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d57f315-cbe2-4d99-983e-1a883eb4d34f),volume_type_id=7d57f315-cbe2-4d99-983e-1a883eb4d34f)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Creating volume 1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:16 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 1073741824 Sep 28 17:13:16 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 Sep 28 17:13:16 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17" returned: 0 in 0.636s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:16 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17 Sep 28 17:13:16 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:16 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 1073741824" returned: 0 in 0.807s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0bc52009-679e-4cd8-8aed-1456d7f73c17" returned: 0 in 0.480s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 Sep 28 17:13:17 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-0bc52009-679e-4cd8-8aed-1456d7f73c17" released by "delete_volume" :: held 1.261s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Created reservations ['6ad9f7fc-886b-4d6e-bfa3-a57c26f2028b', '843824b5-093a-49ef-a2d3-8287a4db0a06', 'dbbe5065-2692-4c9d-860e-7874f76a7df5', 'c71c9652-c0e9-49a7-914f-73dede87fcd2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:17 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721" returned: 0 in 0.354s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598d622c-0618-4ee4-9fc6-77b0148c9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1644586f-ff5b-4b2b-a8a5-f31492076721', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbcf20e-a6dd-4f7c-b735-71e51421473a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Volume volume-1644586f-ff5b-4b2b-a8a5-f31492076721 (1644586f-ff5b-4b2b-a8a5-f31492076721): created successfully Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfbcf20e-a6dd-4f7c-b735-71e51421473a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (a190cd8d-ad15-4b46-8dac-6e4fdc9a3abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8bb8d227-1605-4b34-b0c9-500d28a864d5 tempest-GroupSnapshotsTest-2085416411 None] Created volume successfully. Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:17 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:17 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "cinder-84cf4382-dae7-4fe3-864c-55c15d8cc6f4-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:17 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.332s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Deleted volume successfully. Sep 28 17:13:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-84cf4382-dae7-4fe3-864c-55c15d8cc6f4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-40199ca0-901e-4122-b6ff-622f740f796f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-0bc52009-679e-4cd8-8aed-1456d7f73c17-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "cinder-quobyte-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-quobyte-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[079f6054-aced-4ada-a147-17e6da618107]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-a66816b2-c333-4544-8469-d9f4ab011bd1-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-a66816b2-c333-4544-8469-d9f4ab011bd1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-quobyte-a66816b2-c333-4544-8469-d9f4ab011bd1" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:18 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-a66816b2-c333-4544-8469-d9f4ab011bd1" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:18 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d6ce02-a208-470c-8727-ea2d673e9b09]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 Sep 28 17:13:18 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" returned: 0 in 0.526s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4 Sep 28 17:13:18 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:18 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1" returned: 0 in 0.512s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:18 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1 Sep 28 17:13:18 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-quobyte-84cf4382-dae7-4fe3-864c-55c15d8cc6f4" released by "delete_volume" :: held 1.042s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Created reservations ['c907abf6-9135-4edf-8d64-4c4ca8267208', 'a44a5321-58b5-40df-995b-3c0f394c3681', 'c15a3a00-a4dc-4cf6-bc8e-41d8cad728ab', 'c15d1691-f551-48ca-a765-84a58e78a32a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:19 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a66816b2-c333-4544-8469-d9f4ab011bd1" returned: 0 in 0.531s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-a66816b2-c333-4544-8469-d9f4ab011bd1" released by "delete_volume" :: held 1.133s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (4c53cdc4-f303-4598-9762-0623239cbf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8491ad7-de71-4ee2-a066-b78adc4a8a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:19 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8491ad7-de71-4ee2-a066-b78adc4a8a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1143186745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058d38fa-9110-4386-8524-cc9148524731,host='devstack@QuobyteHD#QuobyteHD',id=6e64798e-8651-45f1-b702-6ac9d1d8dab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:19Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d57f315-cbe2-4d99-983e-1a883eb4d34f),volume_type_id=7d57f315-cbe2-4d99-983e-1a883eb4d34f)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b35d0bb-733c-41c3-80ca-7b3b4b454912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b35d0bb-733c-41c3-80ca-7b3b4b454912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71f2699-7b54-4eea-ac93-7ddcbf6b53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71f2699-7b54-4eea-ac93-7ddcbf6b53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e64798e-8651-45f1-b702-6ac9d1d8dab2', 'volume_name': 'volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfdfc1b-516f-4617-918a-2fba6fd13a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cfdfc1b-516f-4617-918a-2fba6fd13a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb980667-2765-4e2f-86de-1665daca350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Volume 6e64798e-8651-45f1-b702-6ac9d1d8dab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2', 'volume_size': 1} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=058d38fa-9110-4386-8524-cc9148524731,created_at=2026-09-28T15:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1143186745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=058d38fa-9110-4386-8524-cc9148524731,host='devstack@QuobyteHD#QuobyteHD',id=6e64798e-8651-45f1-b702-6ac9d1d8dab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:19Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d57f315-cbe2-4d99-983e-1a883eb4d34f),volume_type_id=7d57f315-cbe2-4d99-983e-1a883eb4d34f)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Creating volume 6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:19 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 1073741824 Sep 28 17:13:19 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Created reservations ['88e6103d-5692-4ab1-aa44-7c1a79333071', 'ea98282e-b36b-41b8-8e13-b327b3e03270', '465c0f2f-736b-4e68-98ed-a897e44d6c0d', '653828c9-aa34-4520-ad9c-45bcdbb6751b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:19 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:19 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:19 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Deleted volume successfully. Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5de400d3-56f8-41fb-a0a2-f0b1940d65dc tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-84cf4382-dae7-4fe3-864c-55c15d8cc6f4-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Deleted volume successfully. Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-013195a0-3400-4d4b-bf30-62c8b088c026 tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-a66816b2-c333-4544-8469-d9f4ab011bd1-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "cinder-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:20 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "cinder-quobyte-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 1073741824" returned: 0 in 0.805s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-quobyte-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" acquired by "delete_volume" :: waited 0.059s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b761c3-0fe0-48b9-a1b5-1e33aeb75958]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:20 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 Sep 28 17:13:20 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e Sep 28 17:13:20 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-8875ff36-0880-4abd-9f2f-1a5b1c68e017-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-8875ff36-0880-4abd-9f2f-1a5b1c68e017-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "cinder-quobyte-8875ff36-0880-4abd-9f2f-1a5b1c68e017" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-8875ff36-0880-4abd-9f2f-1a5b1c68e017" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:21 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2" returned: 0 in 0.441s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] <== create_volume: return (1412ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb980667-2765-4e2f-86de-1665daca350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e83fad5-5957-459d-926d-958cc895626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[397ab6ae-8d56-4ff9-9535-5ebcf09eb800]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Volume volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 (6e64798e-8651-45f1-b702-6ac9d1d8dab2): created successfully Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e83fad5-5957-459d-926d-958cc895626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (4c53cdc4-f303-4598-9762-0623239cbf07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-016961c8-dc4f-4d7f-ae45-e0413a5c816a tempest-GroupSnapshotsTest-2085416411 None] Created volume successfully. Sep 28 17:13:21 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 Sep 28 17:13:21 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" returned: 0 in 0.700s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e Sep 28 17:13:21 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017" returned: 0 in 0.559s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-quobyte-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e" released by "delete_volume" :: held 1.154s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:21 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017 Sep 28 17:13:21 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Created reservations ['3e8b695c-3fa2-4baf-92fe-846a3d930093', 'e0bd1675-3725-4b83-bf10-b520c1ebb4ff', 'ab6edcda-32ab-4b2d-a296-efd6e80f85e4', '47b7fc2f-ca2a-4db6-8534-6f125c1ccc59'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:21 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:21 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8875ff36-0880-4abd-9f2f-1a5b1c68e017" returned: 0 in 0.499s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-quobyte-8875ff36-0880-4abd-9f2f-1a5b1c68e017" released by "delete_volume" :: held 1.148s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Created reservations ['78f62ade-6298-4dd0-8e7d-e00738d66b4e', '1858f94c-ad94-4539-9523-d6aa43305cee', '2c3fb20a-536f-49e8-99fb-e0ce6c6d895d', 'd2a3bd10-fc89-4dae-9d0e-4b5ba96ee7b2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:22 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.506s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Deleted volume successfully. Sep 28 17:13:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-07e5f847-a8de-4c6e-a085-8e09319e0b97 tempest-GroupSnapshotsTest-2085416411 None] Update group completed successfully. Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5aafbb3-5ae2-4951-a71b-4c03b7b33909 tempest-TestServerVolumeAttachmentScenario-1530143575 None] Lock "cinder-e7fd9380-8950-46f6-8ab6-c3c6c21ca11e-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:22 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:22 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:22 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Deleted volume successfully. Sep 28 17:13:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-35bdcc03-0c99-4f64-90c2-70ad8068ac4f tempest-AttachVolumeTestJSON-1766129625 None] Lock "cinder-8875ff36-0880-4abd-9f2f-1a5b1c68e017-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:23 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8d7d65bc-0c65-43f1-a66b-f1117b6f64d3 tempest-GroupSnapshotsTest-2085416411 None] Update group completed successfully. Sep 28 17:13:24 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c251a092-f1ae-4e9a-90c6-55b42661fd0e tempest-GroupSnapshotsTest-2085416411 None] Update group completed successfully. Sep 28 17:13:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-709bdd69-b010-43e5-ae24-554c320d1a3f tempest-GroupSnapshotsTest-2085416411 None] Update group completed successfully. Sep 28 17:13:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] GroupSnapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: creating. Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Group snapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: creating. {{(pid=86842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=136,cinder:UPDATE=118,cinder:INSERT=31,cinder:DELETE=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Creating offline snapshot 4b58f684-7a0d-4541-82fc-d58576ea87b0 of volume 1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5990f70-b115-4132-9f5d-80b95cd0c475]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:28 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 Sep 28 17:13:28 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Flow 'volume_create_manager' (98000f07-34b3-4732-829c-a87ca0fed0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a142b3b-5a4e-42de-9d3b-02557933202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a142b3b-5a4e-42de-9d3b-02557933202d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1045083383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e431e6-21bf-45be-bf0d-6cdb8cc57c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559efe56d0c64a9a88255d774618fe9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:29Z,use_quota=True,user_id='7ce95bda8bf84ee9b657919189a2e689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46349967-e303-4e55-a0c2-cd391c667f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46349967-e303-4e55-a0c2-cd391c667f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993323d4-e919-4cff-8d65-aa11fc5a3ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (993323d4-e919-4cff-8d65-aa11fc5a3ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40e431e6-21bf-45be-bf0d-6cdb8cc57c9d', 'volume_name': 'volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38b695f-eab2-4d63-9884-ffee5485ad4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38b695f-eab2-4d63-9884-ffee5485ad4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5e272c-47e1-425b-a0d1-742f619bdea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Volume 40e431e6-21bf-45be-bf0d-6cdb8cc57c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d', 'volume_size': 1} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:29 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721" returned: 0 in 0.882s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 1G Sep 28 17:13:29 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:29 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 1G" returned: 0 in 0.677s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1644586f-ff5b-4b2b-a8a5-f31492076721 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:29 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1644586f-ff5b-4b2b-a8a5-f31492076721 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 Sep 28 17:13:29 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1644586f-ff5b-4b2b-a8a5-f31492076721 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0" returned: 0 in 0.509s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 Sep 28 17:13:30 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:30 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0" returned: 0 in 0.386s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:30 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info Sep 28 17:13:30 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:31 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info" returned: 0 in 0.441s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info Sep 28 17:13:31 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:31 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.info" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Creating offline snapshot a944a753-03d2-4b02-9e49-cbd21cfc1af4 of volume 6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e267fe0-6fbc-42f9-b6d8-1e165dc2371a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:31 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 Sep 28 17:13:31 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2" returned: 0 in 0.567s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[98334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 1G Sep 28 17:13:32 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:32 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 1G" returned: 0 in 0.565s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:32 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 Sep 28 17:13:32 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4" returned: 0 in 0.451s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 Sep 28 17:13:33 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:33 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:33 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info Sep 28 17:13:33 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info" returned: 0 in 0.370s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info Sep 28 17:13:34 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.info" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.395s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1045083383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40e431e6-21bf-45be-bf0d-6cdb8cc57c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='559efe56d0c64a9a88255d774618fe9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:29Z,use_quota=True,user_id='7ce95bda8bf84ee9b657919189a2e689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Creating volume 40e431e6-21bf-45be-bf0d-6cdb8cc57c9d {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:34 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:34 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d 1073741824 Sep 28 17:13:34 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-71277f19-cc7e-4700-aee3-70eaf9f873bf tempest-GroupSnapshotsTest-2085416411 None] group_snapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: created successfully Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Flow 'volume_create_manager' (0c0783a2-2ae8-48c7-a88d-1a38d881da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39541a17-d1b8-49c4-8f67-d0a458abd5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39541a17-d1b8-49c4-8f67-d0a458abd5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-875357562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8364f3-08e7-4d97-afbe-0a228236449c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6ca74a7b2d4ec09fb7d44ef75a5293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:35Z,use_quota=True,user_id='4928583f5fbb4f2095bd662985521da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f274c7-8c6f-41e7-8d43-561ff6373c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79f274c7-8c6f-41e7-8d43-561ff6373c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaff9a48-b3ab-4766-90fe-dec5ca2d5356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaff9a48-b3ab-4766-90fe-dec5ca2d5356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8364f3-08e7-4d97-afbe-0a228236449c', 'volume_name': 'volume-8a8364f3-08e7-4d97-afbe-0a228236449c', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace6cc40-9785-48cc-8fa3-25bcdd21454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace6cc40-9785-48cc-8fa3-25bcdd21454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4b52ff-3b1c-4a54-98c8-f4045dcab471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Volume 8a8364f3-08e7-4d97-afbe-0a228236449c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8364f3-08e7-4d97-afbe-0a228236449c', 'volume_size': 1} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:35 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d 1073741824" returned: 0 in 0.571s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d Sep 28 17:13:35 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-875357562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8364f3-08e7-4d97-afbe-0a228236449c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad6ca74a7b2d4ec09fb7d44ef75a5293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:35Z,use_quota=True,user_id='4928583f5fbb4f2095bd662985521da9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Creating volume 8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:35 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5e272c-47e1-425b-a0d1-742f619bdea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:35 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c 1073741824 Sep 28 17:13:35 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793ba581-52d6-4e79-889f-93a63d1b36c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Volume volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d (40e431e6-21bf-45be-bf0d-6cdb8cc57c9d): created successfully Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (793ba581-52d6-4e79-889f-93a63d1b36c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Flow 'volume_create_manager' (98000f07-34b3-4732-829c-a87ca0fed0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b1b12834-86ef-48a2-be1f-c684043d822b tempest-VolumeQuotasNegativeTestJSON-387853973 None] Created volume successfully. Sep 28 17:13:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: deleting Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: deleting {{(pid=86842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:13:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-4b58f684-7a0d-4541-82fc-d58576ea87b0" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-4b58f684-7a0d-4541-82fc-d58576ea87b0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Deleting offline snapshot 4b58f684-7a0d-4541-82fc-d58576ea87b0 of volume 1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] snapshot_file for this snap is: volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58cbbb-538f-411a-9619-c90e8a6fa98f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:36 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c 1073741824" returned: 0 in 0.786s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 Sep 28 17:13:36 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:36 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c Sep 28 17:13:36 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:36 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4b52ff-3b1c-4a54-98c8-f4045dcab471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8364f3-08e7-4d97-afbe-0a228236449c', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4e039f-175e-4713-8f9f-252acc8d71a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:36 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Volume volume-8a8364f3-08e7-4d97-afbe-0a228236449c (8a8364f3-08e7-4d97-afbe-0a228236449c): created successfully Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4e039f-175e-4713-8f9f-252acc8d71a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Flow 'volume_create_manager' (0c0783a2-2ae8-48c7-a88d-1a38d881da59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:36 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-ed0c849e-1f21-4594-b724-9504b59c651d req-3737c117-f613-41cb-ac2c-3a6a8cf1757e tempest-VolumesSnapshotsTestJSON-301321654 None] Created volume successfully. Sep 28 17:13:36 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0" returned: 0 in 0.801s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1644586f-ff5b-4b2b-a8a5-f31492076721(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5023ef6c-2b4b-42c4-bdcb-ef62e32840a7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 Sep 28 17:13:37 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Creating offline snapshot 465fca58-45e7-4b5d-8724-921ab6007700 of volume 8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:37 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721" returned: 0 in 0.773s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d886edf1-3948-41bf-bfb4-c5a034078350]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:37 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 Sep 28 17:13:37 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c Sep 28 17:13:38 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Acquiring lock "cinder-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "cinder-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0" returned: 0 in 0.746s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0 Sep 28 17:13:38 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Acquiring lock "cinder-quobyte-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:38 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c" returned: 0 in 0.819s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "cinder-quobyte-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" acquired by "delete_volume" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:38 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 1G Sep 28 17:13:38 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[138687a1-759a-45d4-a61a-0d7fcaa3056c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:38 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d Sep 28 17:13:38 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:38 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721.4b58f684-7a0d-4541-82fc-d58576ea87b0" returned: 0 in 0.450s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-4b58f684-7a0d-4541-82fc-d58576ea87b0" released by "_delete_snapshot" :: held 2.967s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" released by "delete_snapshot" :: held 3.008s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-a944a753-03d2-4b02-9e49-cbd21cfc1af4" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-a944a753-03d2-4b02-9e49-cbd21cfc1af4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Deleting offline snapshot a944a753-03d2-4b02-9e49-cbd21cfc1af4 of volume 6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] snapshot_file for this snap is: volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba8e220-2a5d-48b1-9c60-e78308378e36]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" returned: 0 in 0.635s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 Sep 28 17:13:39 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 1G" returned: 0 in 0.716s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8364f3-08e7-4d97-afbe-0a228236449c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d Sep 28 17:13:39 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8364f3-08e7-4d97-afbe-0a228236449c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 Sep 28 17:13:39 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "cinder-quobyte-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d" released by "delete_volume" :: held 1.112s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:39 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4" returned: 0 in 0.609s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:39 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a8364f3-08e7-4d97-afbe-0a228236449c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:39 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 is being set with open permissions: ugo+rw Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[24070f3e-660f-41d3-9136-ef188e88b052]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:39 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 Sep 28 17:13:39 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=139,cinder:SELECT=136,cinder:DELETE=11,cinder:INSERT=26 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Created reservations ['c60849d4-e681-42b9-868b-88da519820ae', 'a94c3880-962b-43b4-b978-fa0f43a7131e', '8ed6ec66-3571-4bf7-8801-4cd11fda4c27', '22c357ba-86fb-473a-a26e-5d6d9d6807e5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:39 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 Sep 28 17:13:39 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:40 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700" returned: 0 in 0.432s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info Sep 28 17:13:40 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Deleted volume successfully. Sep 28 17:13:40 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2" returned: 0 in 0.599s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b95badb0-0b70-4002-aa01-d81a395395e2 tempest-VolumeQuotasNegativeTestJSON-387853973 None] Lock "cinder-40e431e6-21bf-45be-bf0d-6cdb8cc57c9d-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:40 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 Sep 28 17:13:40 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info is being set with open permissions: ugo+rw Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info Sep 28 17:13:40 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:40 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4" returned: 0 in 0.474s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:40 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4 Sep 28 17:13:40 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:41 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.info" returned: 0 in 0.428s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.467s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-b454b335-b2ce-4b54-b1fe-4d8606589ef2 req-8abafb22-af0a-4a77-98b7-485e5c6aa517 tempest-VolumesSnapshotsTestJSON-301321654 None] Create snapshot completed successfully Sep 28 17:13:41 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2.a944a753-03d2-4b02-9e49-cbd21cfc1af4" returned: 0 in 0.479s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-a944a753-03d2-4b02-9e49-cbd21cfc1af4" released by "_delete_snapshot" :: held 2.310s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" released by "delete_snapshot" :: held 2.351s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:41 devstack cinder-volume[86842]: WARNING cinder.quota [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-104381542 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-104381542, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:41 devstack cinder-volume[86842]: WARNING cinder.quota [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-104381542 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-104381542, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['d071af6d-aae1-41b0-9c20-8795d35cd305', 'e0e46f3e-1b05-4c00-b61c-199b89c75c6a', '65799b2a-9d1b-4880-ac45-8aa09a10f664', '44340130-6cb5-49bb-8a07-f92807ee3e85'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['c4efaccc-3dd3-4167-ac68-7302020c4d99', '2da90efc-9c0b-4a88-b88d-3c35adbe7507', 'e0b67a65-f24c-4055-b395-cce3b729d0f7', '9cdd7406-4053-41fb-b94f-f4d7f7b398cc'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "cinder-465fca58-45e7-4b5d-8724-921ab6007700-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1d84f54a-8d59-42a8-8933-79f6a31d0397 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot c4412a82-671e-48eb-8b66-eac9aa114ebe: deleted successfully Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-465fca58-45e7-4b5d-8724-921ab6007700-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "cinder-quobyte-465fca58-45e7-4b5d-8724-921ab6007700" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-465fca58-45e7-4b5d-8724-921ab6007700" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Deleting offline snapshot 465fca58-45e7-4b5d-8724-921ab6007700 of volume 8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] snapshot_file for this snap is: volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d74c1-047a-4f46-a602-f2a5643a5015]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 Sep 28 17:13:42 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3912c8d-041b-49f2-8b68-419ead84c726]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700" returned: 0 in 0.707s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a8364f3-08e7-4d97-afbe-0a228236449c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9d3d5b-aeac-4ed8-8155-bf70e8767ca3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:42 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 Sep 28 17:13:42 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:42 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c Sep 28 17:13:42 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721" returned: 0 in 0.656s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721 Sep 28 17:13:43 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c" returned: 0 in 0.670s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 Sep 28 17:13:43 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (37360c06-c972-465b-96b4-b56fca09da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dbe57c-755a-4a64-9fa3-a226aba4c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dbe57c-755a-4a64-9fa3-a226aba4c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257699520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7835c195-be1f-43e5-96b3-dd2edcb558b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:43Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02910497-2181-40c0-a607-5a1abf808db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02910497-2181-40c0-a607-5a1abf808db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b6fdab-4fed-4e1b-856b-d7c64611ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b6fdab-4fed-4e1b-856b-d7c64611ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7835c195-be1f-43e5-96b3-dd2edcb558b2', 'volume_name': 'volume-7835c195-be1f-43e5-96b3-dd2edcb558b2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb869840-5187-42c8-a923-0eb29842a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb869840-5187-42c8-a923-0eb29842a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb6318-ce60-4684-a499-87f99752ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume 7835c195-be1f-43e5-96b3-dd2edcb558b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7835c195-be1f-43e5-96b3-dd2edcb558b2', 'volume_size': 1} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:43 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257699520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7835c195-be1f-43e5-96b3-dd2edcb558b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:43Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume 7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:43 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1644586f-ff5b-4b2b-a8a5-f31492076721" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:43 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 1073741824 Sep 28 17:13:43 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-1644586f-ff5b-4b2b-a8a5-f31492076721" released by "delete_volume" :: held 1.128s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[452ab208-a229-4dc1-88b0-5db8b5e44e8e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:43 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 Sep 28 17:13:43 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700" returned: 0 in 0.620s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700 Sep 28 17:13:44 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2" returned: 0 in 0.553s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 1073741824" returned: 0 in 0.740s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2 Sep 28 17:13:44 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c.465fca58-45e7-4b5d-8724-921ab6007700" returned: 0 in 0.418s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:44 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 Sep 28 17:13:44 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:44 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-465fca58-45e7-4b5d-8724-921ab6007700" released by "_delete_snapshot" :: held 2.672s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" released by "delete_snapshot" :: held 2.719s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.quota [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Created reservations ['7e7b1a1b-9dfb-4dd7-bf13-5c95072aadfb', 'ce5e3b7f-bb69-4fe7-a8cf-00db807dc55e', 'b70afae6-b378-4b9e-9701-327e0167ad06', '91a3b886-aea4-43f9-8379-71488233ac32'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:44 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2" returned: 0 in 0.463s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59eb6318-ce60-4684-a499-87f99752ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7835c195-be1f-43e5-96b3-dd2edcb558b2', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0fb1f0-2059-46fd-904b-5f57f9129b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6e64798e-8651-45f1-b702-6ac9d1d8dab2" returned: 0 in 0.613s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.523s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-6e64798e-8651-45f1-b702-6ac9d1d8dab2" released by "delete_volume" :: held 1.326s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:13:45 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 (7835c195-be1f-43e5-96b3-dd2edcb558b2): created successfully Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0fb1f0-2059-46fd-904b-5f57f9129b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (37360c06-c972-465b-96b4-b56fca09da55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Delete snapshot completed successfully. Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-52cf824c-c705-4c58-9a5b-2b3371b17672 req-23d63121-fd07-47ec-a328-5d3023292cf7 tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-465fca58-45e7-4b5d-8724-921ab6007700-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b7afcc5a-036d-401d-897e-33d7555fc9b9 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['e43e1597-50ca-4802-85ad-a20788d33751'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:45 devstack cinder-volume[86842]: WARNING cinder.quota [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-104381542 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-104381542, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "cinder-8a8364f3-08e7-4d97-afbe-0a228236449c-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['3169bbcd-3859-48db-b307-d595117b6533', 'ddd5222d-74ae-4814-86da-441a0a37c7c2', 'fa253727-f934-4e67-a845-4cfb62964879', 'd1d34398-82df-491e-be02-556f06c46e8e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-8a8364f3-08e7-4d97-afbe-0a228236449c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[365ddb2a-b72d-43c8-9b89-399ef739116e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['d0068c41-a88b-42e2-8346-a321bb3753d3', 'faf45766-2c55-45ea-93fc-ce83ca1b516f', '39a9e6a9-a615-439e-a809-9cb89ddc4842', 'c46021c3-60ae-4e02-a3ed-d4302b9a963e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:45 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c Sep 28 17:13:45 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:45 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:45 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating offline snapshot 869ba3fd-cc14-4868-8aef-fd3d13412d5c of volume 7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47be2a-4847-410c-9600-6aaf6dce79f9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c" returned: 0 in 0.807s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:46 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:46 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c Sep 28 17:13:46 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fd3fbd4e-43f8-40ef-ab86-ea91b2357de8 tempest-GroupSnapshotsTest-2085416411 None] Delete group completed successfully. Sep 28 17:13:46 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 Sep 28 17:13:46 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:46 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a8364f3-08e7-4d97-afbe-0a228236449c" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-quobyte-8a8364f3-08e7-4d97-afbe-0a228236449c" released by "delete_volume" :: held 1.329s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:46 devstack cinder-volume[86842]: DEBUG cinder.quota [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Created reservations ['e155111f-af18-4c6b-a7a5-892d29f04d82', 'ad00af1c-2524-4f72-924e-f61f1f4865cf', '8fcf573b-aa87-4360-b1f2-acd9b1222943', '8d14b644-5670-48ef-96b1-15390ac8e7e7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:13:47 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2" returned: 0 in 0.654s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:47 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c 1G Sep 28 17:13:47 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:13:47 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d1fa0844-626a-4f33-8f20-4e9c33d9d863 tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-1075064470: creating Sep 28 17:13:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d1fa0844-626a-4f33-8f20-4e9c33d9d863 tempest-GroupSnapshotsTest-2085416411 None] Group tempest-GroupSnapshotsTest-Group-1075064470: created successfully Sep 28 17:13:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d1fa0844-626a-4f33-8f20-4e9c33d9d863 tempest-GroupSnapshotsTest-2085416411 None] Create group completed successfully. Sep 28 17:13:47 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG cinder.manager [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:13:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Deleted volume successfully. Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-445e1a04-02e2-4418-a46e-4f2534a6a1ff req-d1e550e9-4ea2-49ec-8c32-7913c122571b tempest-VolumesSnapshotsTestJSON-301321654 None] Lock "cinder-8a8364f3-08e7-4d97-afbe-0a228236449c-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:13:47 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c 1G" returned: 0 in 0.587s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:47 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c Sep 28 17:13:47 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c" returned: 0 in 0.411s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c is being set with open permissions: ugo+rw Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c Sep 28 17:13:48 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c" returned: 0 in 0.375s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info Sep 28 17:13:48 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:48 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info" returned: 0 in 0.463s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:48 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info is being set with open permissions: ugo+rw Sep 28 17:13:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:48 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info Sep 28 17:13:48 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (5ee65ee9-2889-4763-9ba0-f1f34c54a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35044d62-f829-4a2b-a177-4e3eb088dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35044d62-f829-4a2b-a177-4e3eb088dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959658959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cd97b4a-0337-410c-b278-61f6972d37c5,host='devstack@QuobyteHD#QuobyteHD',id=7d53bbf6-65f0-42bf-b71e-edff2874751e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:49Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cf92a7-2a21-4050-ac17-415dadeca511),volume_type_id=21cf92a7-2a21-4050-ac17-415dadeca511)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146ce52e-36b2-4ce2-a465-bbd065674154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (146ce52e-36b2-4ce2-a465-bbd065674154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095a7ad-80cd-4d1b-ac62-c05c29e88a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b095a7ad-80cd-4d1b-ac62-c05c29e88a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d53bbf6-65f0-42bf-b71e-edff2874751e', 'volume_name': 'volume-7d53bbf6-65f0-42bf-b71e-edff2874751e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f0478-a609-465d-87f9-8f9715622325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0f0478-a609-465d-87f9-8f9715622325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c52961-cb4d-44ad-9d1c-e117f5fcb8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:49 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Volume 7d53bbf6-65f0-42bf-b71e-edff2874751e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d53bbf6-65f0-42bf-b71e-edff2874751e', 'volume_size': 1} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:49 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.info" returned: 0 in 0.434s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.120s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0cd97b4a-0337-410c-b278-61f6972d37c5,created_at=2026-09-28T15:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959658959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0cd97b4a-0337-410c-b278-61f6972d37c5,host='devstack@QuobyteHD#QuobyteHD',id=7d53bbf6-65f0-42bf-b71e-edff2874751e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54420bfc38ab4eb18eab83dea36c2b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:49Z,use_quota=True,user_id='f5458e1cf76b4490b39496f421edfdbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21cf92a7-2a21-4050-ac17-415dadeca511),volume_type_id=21cf92a7-2a21-4050-ac17-415dadeca511)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Creating volume 7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:49 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:49 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e 1073741824 Sep 28 17:13:49 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-51714015-589a-4cac-9692-ce027b6d1cfa tempest-CreateVolumesFromSnapshotTest-1399147081 None] Create snapshot completed successfully Sep 28 17:13:50 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e 1073741824" returned: 0 in 0.661s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:50 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e Sep 28 17:13:50 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:50 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e" returned: 0 in 0.419s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2c52961-cb4d-44ad-9d1c-e117f5fcb8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d53bbf6-65f0-42bf-b71e-edff2874751e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f14e28-5e44-4954-93b4-1686c75afdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Volume volume-7d53bbf6-65f0-42bf-b71e-edff2874751e (7d53bbf6-65f0-42bf-b71e-edff2874751e): created successfully Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f14e28-5e44-4954-93b4-1686c75afdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Flow 'volume_create_manager' (5ee65ee9-2889-4763-9ba0-f1f34c54a05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d30d546b-c879-4536-bb45-b3ecdff3a259 tempest-GroupSnapshotsTest-2085416411 None] Created volume successfully. Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (70575382-4fe6-4e42-981e-01324eb93655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8187d6-a8c8-4a71-a365-24245083e193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8187d6-a8c8-4a71-a365-24245083e193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-830827346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c8d8e0-0f9f-45bb-8878-7f72278fa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:51Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d259368-0d55-48f7-80fc-20e4f1308a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d259368-0d55-48f7-80fc-20e4f1308a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d1f289-e104-4fc0-aaba-f62e2a56b455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d1f289-e104-4fc0-aaba-f62e2a56b455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c8d8e0-0f9f-45bb-8878-7f72278fa6cc', 'volume_name': 'volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df3c2b4-82be-4e56-a87e-62109da33174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8df3c2b4-82be-4e56-a87e-62109da33174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c7ef4-7377-4f6c-a715-536cef23f934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:51 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume 70c8d8e0-0f9f-45bb-8878-7f72278fa6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc', 'volume_size': 1} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-830827346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c8d8e0-0f9f-45bb-8878-7f72278fa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:51Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume 70c8d8e0-0f9f-45bb-8878-7f72278fa6cc {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:51 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:51 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc 1073741824 Sep 28 17:13:51 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (84415c99-9090-4a39-8c0e-930a5e3891f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a954a08-6cbd-450f-a72d-b6e437b929a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a954a08-6cbd-450f-a72d-b6e437b929a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376471463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24447cb-44d1-4983-b048-b57140d2dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:52Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eff1e3-ce17-4dda-9cd8-162552c84ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22eff1e3-ce17-4dda-9cd8-162552c84ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e789933-457b-4757-ba5e-9adfda75613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e789933-457b-4757-ba5e-9adfda75613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24447cb-44d1-4983-b048-b57140d2dfee', 'volume_name': 'volume-b24447cb-44d1-4983-b048-b57140d2dfee', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67406b38-4038-4995-841b-419e66bed0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67406b38-4038-4995-841b-419e66bed0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944fce12-e2a0-4354-a36b-c3f5be2fe2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume b24447cb-44d1-4983-b048-b57140d2dfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24447cb-44d1-4983-b048-b57140d2dfee', 'volume_size': 1} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:52 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc 1073741824" returned: 0 in 0.946s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] GroupSnapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: creating. Sep 28 17:13:52 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc Sep 28 17:13:52 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Group snapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: creating. {{(pid=86842) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (374f4f31-5792-4ee0-829e-fc56e37aea1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19144709-0216-48d3-9564-9da40a23b165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19144709-0216-48d3-9564-9da40a23b165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122555410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48aedaad-cf05-43b9-bfa2-eb03789de9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:53Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7673f2f6-2515-498b-a097-642bb8ffc313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7673f2f6-2515-498b-a097-642bb8ffc313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2204c17e-88f0-4c92-a94b-27e3a365d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2204c17e-88f0-4c92-a94b-27e3a365d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48aedaad-cf05-43b9-bfa2-eb03789de9ef', 'volume_name': 'volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52db5145-e649-45ca-b00c-b942f3630da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52db5145-e649-45ca-b00c-b942f3630da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c3a2ea-15d5-4a67-bcc4-b3797db425c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume 48aedaad-cf05-43b9-bfa2-eb03789de9ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef', 'volume_size': 1} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:53 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" returned: 0 in 0.581s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.679s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-376471463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24447cb-44d1-4983-b048-b57140d2dfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:52Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume b24447cb-44d1-4983-b048-b57140d2dfee {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:53 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (496c7ef4-7377-4f6c-a715-536cef23f934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9858f3-c302-46bb-b3b4-d478ac785346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee 1073741824 Sep 28 17:13:53 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:53 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc (70c8d8e0-0f9f-45bb-8878-7f72278fa6cc): created successfully Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9858f3-c302-46bb-b3b4-d478ac785346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (70575382-4fe6-4e42-981e-01324eb93655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e83a32b3-a19c-4566-857c-a94d9a737d78 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (d4a93b8f-4437-4df7-9a74-178b0840a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056add34-7a8b-4640-b47b-4ab091cfb9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056add34-7a8b-4640-b47b-4ab091cfb9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241528597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef88406a-80e9-4ffa-96fb-f6d86ab353ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:54Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f383afe-dfc1-4531-8c04-229e2c8464b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f383afe-dfc1-4531-8c04-229e2c8464b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef84ea96-09fb-4b2c-8a07-4d60fdb6df46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef84ea96-09fb-4b2c-8a07-4d60fdb6df46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef88406a-80e9-4ffa-96fb-f6d86ab353ec', 'volume_name': 'volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2b5e19-014c-47e5-bb4a-9357ad643c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed2b5e19-014c-47e5-bb4a-9357ad643c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedc8d4d-e818-4daa-95df-f40e71ad086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:53 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume ef88406a-80e9-4ffa-96fb-f6d86ab353ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec', 'volume_size': 1} Sep 28 17:13:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:54 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee 1073741824" returned: 0 in 0.915s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:54 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee Sep 28 17:13:54 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (d91132a7-d377-4734-97bf-a53726b3e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9f08ef-a52c-4d71-b189-55f8da607ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9f08ef-a52c-4d71-b189-55f8da607ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63139824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947486be-e2c9-40aa-9b5b-7cbba61c3694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:54Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43099862-bfdb-465d-a12b-e22b40a89a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43099862-bfdb-465d-a12b-e22b40a89a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a3f545-e98f-4e15-acf3-ac04a833f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10a3f545-e98f-4e15-acf3-ac04a833f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947486be-e2c9-40aa-9b5b-7cbba61c3694', 'volume_name': 'volume-947486be-e2c9-40aa-9b5b-7cbba61c3694', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f741636-715e-4ee2-b408-864e7329129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f741636-715e-4ee2-b408-864e7329129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cb3588-65c9-40b4-b7d2-1078f4a8a575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume 947486be-e2c9-40aa-9b5b-7cbba61c3694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947486be-e2c9-40aa-9b5b-7cbba61c3694', 'volume_size': 1} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:54 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee" returned: 0 in 0.361s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.849s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944fce12-e2a0-4354-a36b-c3f5be2fe2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24447cb-44d1-4983-b048-b57140d2dfee', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca3baa-d4e2-45c2-a88a-83ae11192e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Creating offline snapshot 9085f2f8-4735-4f10-b552-b24d30969319 of volume 7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d0a13-87d2-4f7d-8ced-c2a1482eecb7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:54 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-b24447cb-44d1-4983-b048-b57140d2dfee (b24447cb-44d1-4983-b048-b57140d2dfee): created successfully Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ca3baa-d4e2-45c2-a88a-83ae11192e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (84415c99-9090-4a39-8c0e-930a5e3891f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:54 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e Sep 28 17:13:54 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9a52b285-d0f4-4ecd-b61f-f9200a4f9709 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:13:55 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e" returned: 0 in 0.494s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:55 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 1G Sep 28 17:13:55 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:55 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 1G" returned: 0 in 0.601s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d53bbf6-65f0-42bf-b71e-edff2874751e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:55 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d53bbf6-65f0-42bf-b71e-edff2874751e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 Sep 28 17:13:55 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d53bbf6-65f0-42bf-b71e-edff2874751e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 Sep 28 17:13:56 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319" returned: 0 in 0.317s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info Sep 28 17:13:56 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:56 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info" returned: 0 in 0.429s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:56 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 17:13:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:56 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info Sep 28 17:13:56 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:57 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.info" returned: 0 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.224s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-122555410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48aedaad-cf05-43b9-bfa2-eb03789de9ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:53Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume 48aedaad-cf05-43b9-bfa2-eb03789de9ef {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:57 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:57 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef 1073741824 Sep 28 17:13:57 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9e836cb3-43d0-46da-9eb2-f78c426660df tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: created successfully Sep 28 17:13:57 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef 1073741824" returned: 0 in 0.644s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef Sep 28 17:13:58 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:58 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: deleting Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: deleting {{(pid=86842) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-9085f2f8-4735-4f10-b552-b24d30969319" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:13:58 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-9085f2f8-4735-4f10-b552-b24d30969319" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Deleting offline snapshot 9085f2f8-4735-4f10-b552-b24d30969319 of volume 7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] snapshot_file for this snap is: volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef" returned: 0 in 0.442s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.576s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241528597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef88406a-80e9-4ffa-96fb-f6d86ab353ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:54Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume ef88406a-80e9-4ffa-96fb-f6d86ab353ec {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:58 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0486ea7c-d914-4d12-9300-30ddd9ec333d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:58 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec 1073741824 Sep 28 17:13:58 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c3a2ea-15d5-4a67-bcc4-b3797db425c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560a9aee-d120-4a34-b13e-647455bc39bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef (48aedaad-cf05-43b9-bfa2-eb03789de9ef): created successfully Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560a9aee-d120-4a34-b13e-647455bc39bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (374f4f31-5792-4ee0-829e-fc56e37aea1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:13:58 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-90887163-d2f5-48b2-86ad-55e290482cd8 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:13:58 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 Sep 28 17:13:58 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec 1073741824" returned: 0 in 0.780s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319" returned: 0 in 0.775s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d53bbf6-65f0-42bf-b71e-edff2874751e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd7647-63da-4b45-a1ca-8087e3c42af9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec Sep 28 17:13:59 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e Sep 28 17:13:59 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" returned: 0 in 0.469s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.519s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-63139824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947486be-e2c9-40aa-9b5b-7cbba61c3694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4904d31aed64e26b8070189df89065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:13:54Z,use_quota=True,user_id='df4237c7af414a45b5b7d2c60fb3d5c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Creating volume 947486be-e2c9-40aa-9b5b-7cbba61c3694 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:13:59 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:13:59 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 1073741824 Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aedc8d4d-e818-4daa-95df-f40e71ad086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14a4c24-6a9f-4cc6-a4e5-1adaa324aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:13:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec (ef88406a-80e9-4ffa-96fb-f6d86ab353ec): created successfully Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f14a4c24-6a9f-4cc6-a4e5-1adaa324aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:13:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (d4a93b8f-4437-4df7-9a74-178b0840a086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:00 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e" returned: 0 in 0.730s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6626f4a4-4200-4220-ad40-7ac09e76f35f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:14:00 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 Sep 28 17:14:00 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 1073741824" returned: 0 in 0.767s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 Sep 28 17:14:00 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:00 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319" returned: 0 in 0.799s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:00 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319 Sep 28 17:14:00 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:01 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05cb3588-65c9-40b4-b7d2-1078f4a8a575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947486be-e2c9-40aa-9b5b-7cbba61c3694', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f609c03-6939-4dfc-95e5-2fcc0c145ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Volume volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 (947486be-e2c9-40aa-9b5b-7cbba61c3694): created successfully Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f609c03-6939-4dfc-95e5-2fcc0c145ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Flow 'volume_create_manager' (d91132a7-d377-4734-97bf-a53726b3e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e94219b1-9fac-4b12-adea-d2bd30ca2065 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created volume successfully. Sep 28 17:14:01 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e.9085f2f8-4735-4f10-b552-b24d30969319" returned: 0 in 0.448s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-9085f2f8-4735-4f10-b552-b24d30969319" released by "_delete_snapshot" :: held 2.957s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" released by "delete_snapshot" :: held 2.983s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:01 devstack cinder-volume[86842]: WARNING cinder.quota [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-7190325 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-7190325, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:01 devstack cinder-volume[86842]: WARNING cinder.quota [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-7190325 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-7190325, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:01 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['e87ca144-d5ad-4953-bef3-41025eec4e88', 'a6bb3b0f-3905-42bc-a0cf-91563cdc04dd', '6ec14e76-3636-40d5-8197-d85bbf289f44', '9b59a23a-a3df-49d1-a02e-8592bacc0fa8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-bb763603-d4c6-4eb6-a796-4f0e6f8ff274 tempest-GroupSnapshotsTest-2085416411 None] group_snapshot a8022c2c-f2d5-48f8-9fca-237fbc88d2ee: deleted successfully Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-947486be-e2c9-40aa-9b5b-7cbba61c3694-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-947486be-e2c9-40aa-9b5b-7cbba61c3694-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-947486be-e2c9-40aa-9b5b-7cbba61c3694" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-947486be-e2c9-40aa-9b5b-7cbba61c3694" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e5d9d8-fd67-4e2e-b6ed-316cc70216d1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" acquired by "delete_volume" :: waited 0.043s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[756eb0e0-26b5-45be-affc-1e1d74d3fdd9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:02 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 Sep 28 17:14:02 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:02 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e Sep 28 17:14:02 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694" returned: 0 in 0.668s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694 Sep 28 17:14:03 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e" returned: 0 in 0.631s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:03 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e Sep 28 17:14:03 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:03 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-947486be-e2c9-40aa-9b5b-7cbba61c3694" returned: 0 in 0.480s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-947486be-e2c9-40aa-9b5b-7cbba61c3694" released by "delete_volume" :: held 1.255s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:03 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7d53bbf6-65f0-42bf-b71e-edff2874751e" returned: 0 in 0.490s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Lock "cinder-quobyte-7d53bbf6-65f0-42bf-b71e-edff2874751e" released by "delete_volume" :: held 1.248s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['303a1cfd-879c-459e-8ff7-da57491545cc', 'e6b1025e-92fe-4a64-b324-8cb21e5be8e2', 'a625e811-1b67-48a0-9002-2898acbdf1f8', 'faa10667-3749-4fcb-ad86-4c68825f3b11'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['24e3a6f2-1bce-4efe-b91d-ebb22e2e0f0f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack cinder-volume[86842]: WARNING cinder.quota [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-7190325 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-7190325, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:04 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:04 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Created reservations ['9e026e8b-d6d6-4d39-b151-c153c0495b96', 'fa49b690-a0e5-4b55-863d-cbb8b26038df', '92f28568-6cb3-448c-8745-dd944e12f73a', 'a9b75da1-44f7-47eb-b036-0c47a189207d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:04 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:04 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:04 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.544s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03a3942e-0a0c-421c-bf81-d47a267ed978 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-947486be-e2c9-40aa-9b5b-7cbba61c3694-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-ef88406a-80e9-4ffa-96fb-f6d86ab353ec-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-ef88406a-80e9-4ffa-96fb-f6d86ab353ec-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:05 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.649s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-20bfc9f0-ab2a-4217-95d7-d0a4d7162993 tempest-GroupSnapshotsTest-2085416411 None] Delete group completed successfully. Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2117fad1-f29a-4be2-9bdf-a64e947a823e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec Sep 28 17:14:05 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:05 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:05 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec Sep 28 17:14:05 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" returned: 0 in 0.431s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-ef88406a-80e9-4ffa-96fb-f6d86ab353ec" released by "delete_volume" :: held 1.064s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['39d6514a-cfbf-47bd-982a-d27f363d3af2', 'dc35147e-81ea-4059-b2b9-0e0359b51d05', '54b4e2d8-76a6-4a59-96c3-1b385e65bde1', '99c73132-7e9d-4529-a885-60186ff61ee4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Flow 'volume_create_manager' (9383adb2-0f10-4215-a21d-4c1ad9c12c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad836f7c-0ebb-43bf-bec7-4afabcf090b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad836f7c-0ebb-43bf-bec7-4afabcf090b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-290424234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5167e395-a8ba-4208-abe6-53422e21cc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07566e53eb644d0e9ac991da2670ee40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:06Z,use_quota=True,user_id='7a5fdf7c61d846719f7a28b2548a8dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af8d06c-56ec-429c-9971-4a3617beea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af8d06c-56ec-429c-9971-4a3617beea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff0285-0a40-4893-9c54-4930dd92795a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ff0285-0a40-4893-9c54-4930dd92795a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5167e395-a8ba-4208-abe6-53422e21cc73', 'volume_name': 'volume-5167e395-a8ba-4208-abe6-53422e21cc73', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc62666-615d-474d-a826-69d7d5803eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc62666-615d-474d-a826-69d7d5803eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41792780-d999-4e01-ad67-89e86406610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Volume 5167e395-a8ba-4208-abe6-53422e21cc73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5167e395-a8ba-4208-abe6-53422e21cc73', 'volume_size': 1} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-290424234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5167e395-a8ba-4208-abe6-53422e21cc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07566e53eb644d0e9ac991da2670ee40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:06Z,use_quota=True,user_id='7a5fdf7c61d846719f7a28b2548a8dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Creating volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:06 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 1073741824 Sep 28 17:14:06 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:06 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:06 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.501s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2e873081-e0ea-4af9-88e5-cd8753b441de tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-ef88406a-80e9-4ffa-96fb-f6d86ab353ec-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:07 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 1073741824" returned: 0 in 0.808s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-48aedaad-cf05-43b9-bfa2-eb03789de9ef-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-48aedaad-cf05-43b9-bfa2-eb03789de9ef-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 Sep 28 17:14:07 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-48aedaad-cf05-43b9-bfa2-eb03789de9ef" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-48aedaad-cf05-43b9-bfa2-eb03789de9ef" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcfa87a-b109-4e0e-95c5-6a92d2bc9046]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:07 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef Sep 28 17:14:07 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:07 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41792780-d999-4e01-ad67-89e86406610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5167e395-a8ba-4208-abe6-53422e21cc73', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce730cb-23ba-49aa-946e-b1227872ed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Volume volume-5167e395-a8ba-4208-abe6-53422e21cc73 (5167e395-a8ba-4208-abe6-53422e21cc73): created successfully Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce730cb-23ba-49aa-946e-b1227872ed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Flow 'volume_create_manager' (9383adb2-0f10-4215-a21d-4c1ad9c12c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-32fe41ff-af08-43ef-9538-0da70d486712 tempest-SnapshotsActionsTest-796090136 None] Created volume successfully. Sep 28 17:14:08 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef" returned: 0 in 0.622s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef Sep 28 17:14:08 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:08 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-48aedaad-cf05-43b9-bfa2-eb03789de9ef" returned: 0 in 0.363s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-48aedaad-cf05-43b9-bfa2-eb03789de9ef" released by "delete_volume" :: held 1.065s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['1c5851cc-2780-4c31-96ed-97a4da8cebbd', '4491e271-e812-46e1-91c8-6bab236ff58c', 'd37c1bbd-3b5e-4708-aa07-f0d081e1d24b', 'f761c879-070b-47db-a82e-167f04955258'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Creating offline snapshot c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f04ee83-32a6-4fc8-a670-38ceb33a0d46]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:08 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:08 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 Sep 28 17:14:09 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.333s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70fcef11-533e-4add-a7c6-96629c359f0f tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-48aedaad-cf05-43b9-bfa2-eb03789de9ef-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:09 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73" returned: 0 in 0.565s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:09 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 1G Sep 28 17:14:09 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-b24447cb-44d1-4983-b048-b57140d2dfee-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-b24447cb-44d1-4983-b048-b57140d2dfee-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-b24447cb-44d1-4983-b048-b57140d2dfee" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-b24447cb-44d1-4983-b048-b57140d2dfee" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e979e3-84ad-45a8-8cc0-c4e1cfc69dc8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 1G" returned: 0 in 0.641s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee Sep 28 17:14:10 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:10 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee Sep 28 17:14:10 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.521s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 is being set with open permissions: ugo+rw Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:10 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:10 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:10 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b24447cb-44d1-4983-b048-b57140d2dfee" returned: 0 in 0.329s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-b24447cb-44d1-4983-b048-b57140d2dfee" released by "delete_volume" :: held 0.917s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:10 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['f6a73d6c-21eb-47c4-b801-b75c01d1fae9', 'fb9b881c-f182-46de-903e-f7428072c6c0', '1e4f16a2-bbd2-46bb-9762-144d3b30ccac', '9ef365ab-dc55-455c-a068-81c44be9b0df'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:11 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:11 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info Sep 28 17:14:11 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:11 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info" returned: 0 in 0.426s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info is being set with open permissions: ugo+rw Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:11 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:11 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info Sep 28 17:14:11 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2ce7e107-a0f7-4514-8e85-b0ab62f5b5bb tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-b24447cb-44d1-4983-b048-b57140d2dfee-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:11 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.info" returned: 0 in 0.333s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.025s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cb0d5447-2e15-45c2-8843-88025ed9d559 tempest-SnapshotsActionsTest-796090136 None] Create snapshot completed successfully Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[21aeaa43-6559-4499-b823-9bde0be0ef96]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc Sep 28 17:14:12 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:12 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" returned: 0 in 0.509s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:12 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc Sep 28 17:14:12 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Creating offline snapshot 1141050b-ac29-477f-aa9d-058f64e85f91 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:13 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" returned: 0 in 0.392s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[837934ee-f03b-4848-96c7-8eb20a69df40]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc" released by "delete_volume" :: held 0.986s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['f39a09f6-bcf7-436b-abde-47b645f791be', 'de0843c3-05dc-4bb7-8dca-3f009c18865d', '3d3979d0-9882-48f6-993e-c537f00cd09d', 'f0f9038b-ba5e-41ba-a8a7-876c7efd1feb'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:13 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:13 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:13 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:13 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:13 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.610s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ef0a3d9c-0cfc-41c6-9504-9bc13ddd5d38 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-70c8d8e0-0f9f-45bb-8878-7f72278fa6cc-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:13 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 1G Sep 28 17:14:13 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-869ba3fd-cc14-4868-8aef-fd3d13412d5c-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-869ba3fd-cc14-4868-8aef-fd3d13412d5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-869ba3fd-cc14-4868-8aef-fd3d13412d5c" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-869ba3fd-cc14-4868-8aef-fd3d13412d5c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleting offline snapshot 869ba3fd-cc14-4868-8aef-fd3d13412d5c of volume 7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:14 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] snapshot_file for this snap is: volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 1G" returned: 0 in 0.798s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7549bb-a220-4d91-8e39-ff6a95b66985]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:14 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 Sep 28 17:14:14 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:14 devstack sudo[98757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c Sep 28 17:14:14 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91" returned: 0 in 0.539s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 is being set with open permissions: ugo+rw Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 Sep 28 17:14:15 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c" returned: 0 in 0.651s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7835c195-be1f-43e5-96b3-dd2edcb558b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Flow 'volume_create_manager' (708c9a02-9965-428b-b3f8-84a5e62184ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859fd096-913b-4b2d-8829-dec01714e662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed7e7c3-7943-4262-b6a5-50b0c5404267]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859fd096-913b-4b2d-8829-dec01714e662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-417109302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20a5772-5cd3-4485-8863-9312466e7c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0474928e659453a8ece1f28169362f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:15Z,use_quota=True,user_id='e56be772667e4d22a3bfeb4f2ac5c0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb988cb9-0368-4f78-aca1-1c3eb78245a1),volume_type_id=eb988cb9-0368-4f78-aca1-1c3eb78245a1)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ec7a11-0fa3-4c9c-9610-28efd01bc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ec7a11-0fa3-4c9c-9610-28efd01bc465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a32d714-861a-402b-8889-21c98fd0265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a32d714-861a-402b-8889-21c98fd0265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b20a5772-5cd3-4485-8863-9312466e7c15', 'volume_name': 'volume-b20a5772-5cd3-4485-8863-9312466e7c15', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585d52a5-2e62-4e6f-ac30-8c72bcb97cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (585d52a5-2e62-4e6f-ac30-8c72bcb97cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63560f-841d-4b4a-8fe8-683b9fd96f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Volume b20a5772-5cd3-4485-8863-9312466e7c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b20a5772-5cd3-4485-8863-9312466e7c15', 'volume_size': 1} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91" returned: 0 in 0.406s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:15 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 Sep 28 17:14:15 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.114s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-417109302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b20a5772-5cd3-4485-8863-9312466e7c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0474928e659453a8ece1f28169362f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:15Z,use_quota=True,user_id='e56be772667e4d22a3bfeb4f2ac5c0ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eb988cb9-0368-4f78-aca1-1c3eb78245a1),volume_type_id=eb988cb9-0368-4f78-aca1-1c3eb78245a1)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Creating volume b20a5772-5cd3-4485-8863-9312466e7c15 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:15 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:15 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 1073741824 Sep 28 17:14:15 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4c95e6bf-a8e6-4e6f-8835-89c77047fe64 tempest-SnapshotsActionsTest-796090136 None] Create snapshot completed successfully Sep 28 17:14:16 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2" returned: 0 in 0.608s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c Sep 28 17:14:16 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 1073741824" returned: 0 in 0.765s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-1141050b-ac29-477f-aa9d-058f64e85f91-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-1141050b-ac29-477f-aa9d-058f64e85f91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:16 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 Sep 28 17:14:16 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-1141050b-ac29-477f-aa9d-058f64e85f91" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:16 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c" returned: 0 in 0.634s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-1141050b-ac29-477f-aa9d-058f64e85f91" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Deleting offline snapshot 1141050b-ac29-477f-aa9d-058f64e85f91 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:16 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c Sep 28 17:14:16 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] snapshot_file for this snap is: volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ad9b15-946c-47d2-a870-8ec48ecb3af7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:17 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 Sep 28 17:14:17 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:17 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a63560f-841d-4b4a-8fe8-683b9fd96f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b20a5772-5cd3-4485-8863-9312466e7c15', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd972cda-c299-41fd-a8e6-953c1cef5d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Volume volume-b20a5772-5cd3-4485-8863-9312466e7c15 (b20a5772-5cd3-4485-8863-9312466e7c15): created successfully Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd972cda-c299-41fd-a8e6-953c1cef5d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Flow 'volume_create_manager' (708c9a02-9965-428b-b3f8-84a5e62184ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-62e2a263-c14c-4f26-b6af-7b8d85281fdc tempest-VolumeTypesAccessTest-820103284 None] Created volume successfully. Sep 28 17:14:17 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2.869ba3fd-cc14-4868-8aef-fd3d13412d5c" returned: 0 in 0.530s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-869ba3fd-cc14-4868-8aef-fd3d13412d5c" released by "_delete_snapshot" :: held 2.658s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" released by "delete_snapshot" :: held 2.714s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:17 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91" returned: 0 in 0.575s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4cf495-0f31-4c13-8b3c-5a3a7be0016d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['b89f3dd8-9e7b-4852-9719-386e9a0e035c', 'a35436f2-6128-4f9b-87ee-a998ce05e24c', 'f98032df-6258-4726-afc3-fa80e5a96164', '5847ae2b-3a94-4247-85b2-7a099ab98626'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Delete snapshot completed successfully. Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a35b7ebe-b9d3-44d0-9208-b5a92f403dd4 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-869ba3fd-cc14-4868-8aef-fd3d13412d5c-delete_snapshot" released by "delete_snapshot" :: held 3.080s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:17 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:17 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Acquiring lock "cinder-b20a5772-5cd3-4485-8863-9312466e7c15-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "cinder-b20a5772-5cd3-4485-8863-9312466e7c15-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Acquiring lock "cinder-quobyte-b20a5772-5cd3-4485-8863-9312466e7c15" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "cinder-quobyte-b20a5772-5cd3-4485-8863-9312466e7c15" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-7835c195-be1f-43e5-96b3-dd2edcb558b2-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b96939-1cb3-4531-bc73-abe605043243]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-7835c195-be1f-43e5-96b3-dd2edcb558b2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:18 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.629s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c262ed-b032-4182-af6d-b79e6c819876]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 Sep 28 17:14:18 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 Sep 28 17:14:18 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 Sep 28 17:14:18 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15" returned: 0 in 0.789s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15 Sep 28 17:14:18 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2" returned: 0 in 0.716s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:18 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2 Sep 28 17:14:18 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:18 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91" returned: 0 in 0.784s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91 Sep 28 17:14:19 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b20a5772-5cd3-4485-8863-9312466e7c15" returned: 0 in 0.438s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "cinder-quobyte-b20a5772-5cd3-4485-8863-9312466e7c15" released by "delete_volume" :: held 1.306s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack cinder-volume[86842]: WARNING cinder.quota [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-958705620 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-958705620, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:19 devstack cinder-volume[86842]: WARNING cinder.quota [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-958705620 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-958705620, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:14:19 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7835c195-be1f-43e5-96b3-dd2edcb558b2" returned: 0 in 0.404s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Created reservations ['38f053ba-f310-4b7a-becf-94996b12f464', 'f1062751-7f61-4b63-b143-4cc00ba26d78', 'd70afaf8-c06c-4bf0-b892-64c1d34b6e22', '8b94bb37-0b19-48ed-9dd5-fa5f29f20218'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-quobyte-7835c195-be1f-43e5-96b3-dd2edcb558b2" released by "delete_volume" :: held 1.243s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1141050b-ac29-477f-aa9d-058f64e85f91" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-1141050b-ac29-477f-aa9d-058f64e85f91" released by "_delete_snapshot" :: held 2.626s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_snapshot" :: held 2.679s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Created reservations ['f3960e95-7768-43e8-b206-0410a70e93d5', 'f8ebd509-d99e-44f0-a6f9-76b86b9b7f01', '4e0c8685-fecc-4b39-81ce-edcca97a3cff', 'a5c83415-d7f1-42f9-804a-edfcbed8c3e5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:19 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:19 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Created reservations ['026e6d88-3c52-4842-8e8b-ad55e68f6682', '2aa85144-d0a6-4ce2-ad6d-fb6cd1c7d2ea', 'c9550a1e-f1b0-4565-85c4-9daf01bedca0', '52b01693-368b-4aeb-be5e-2e2535065df0'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:19 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:19 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Delete snapshot completed successfully. Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-497ae732-8795-4c95-8b9c-d284fcf166ef tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-1141050b-ac29-477f-aa9d-058f64e85f91-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:19 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.383s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Deleted volume successfully. Sep 28 17:14:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-51ea97ef-0538-4de1-968b-7c1574bfe656 tempest-VolumeTypesAccessTest-820103284 None] Lock "cinder-b20a5772-5cd3-4485-8863-9312466e7c15-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.442s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:20 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Deleted volume successfully. Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a9a75a3-36c5-441b-83f3-5ff045527c96 tempest-CreateVolumesFromSnapshotTest-1399147081 None] Lock "cinder-7835c195-be1f-43e5-96b3-dd2edcb558b2-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Creating offline snapshot 1c0fbdcd-2a83-4c4f-8110-68cf386da404 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bcd421-8c2d-455a-9d17-6f4d2d6c5fa2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:20 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:20 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.522s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 1G Sep 28 17:14:21 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:21 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 1G" returned: 0 in 0.791s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:21 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 Sep 28 17:14:21 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404" returned: 0 in 0.598s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:22 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 is being set with open permissions: ugo+rw Sep 28 17:14:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:22 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 Sep 28 17:14:22 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:22 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a1237687-2acf-407c-ad4c-8e2f2cabf3f8 tempest-SnapshotsActionsTest-796090136 None] Create snapshot completed successfully Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-1c0fbdcd-2a83-4c4f-8110-68cf386da404-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-1c0fbdcd-2a83-4c4f-8110-68cf386da404-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-1c0fbdcd-2a83-4c4f-8110-68cf386da404" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-1c0fbdcd-2a83-4c4f-8110-68cf386da404" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Deleting offline snapshot 1c0fbdcd-2a83-4c4f-8110-68cf386da404 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] snapshot_file for this snap is: volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d67a0-dacf-4acf-a3fb-93664786dc56]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:24 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 Sep 28 17:14:24 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:24 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404" returned: 0 in 0.628s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:24 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[976d0f6d-aa53-42e1-8d6f-bfafd049cb1d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:24 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:24 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:25 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.663s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:25 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 Sep 28 17:14:25 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404" returned: 0 in 0.716s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404 Sep 28 17:14:26 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (3ad973e6-d630-46a2-a203-9f420a1547e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978f1f2a-5b9a-43ba-aac3-7d99e8dfb9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978f1f2a-5b9a-43ba-aac3-7d99e8dfb9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784908053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da31e3b4-edfa-437e-8149-a1f82bb978ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:26Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9970e5dd-a23c-4b64-96e0-8269606c9171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9970e5dd-a23c-4b64-96e0-8269606c9171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1c5605-f631-4713-b725-5538be59fd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1c5605-f631-4713-b725-5538be59fd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da31e3b4-edfa-437e-8149-a1f82bb978ce', 'volume_name': 'volume-da31e3b4-edfa-437e-8149-a1f82bb978ce', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d602139b-dbb8-4913-8b26-ff63f19fd130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d602139b-dbb8-4913-8b26-ff63f19fd130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42ddd7f-7454-4e6f-b710-ff29d7607f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume da31e3b4-edfa-437e-8149-a1f82bb978ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da31e3b4-edfa-437e-8149-a1f82bb978ce', 'volume_size': 1} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-784908053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da31e3b4-edfa-437e-8149-a1f82bb978ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:26Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume da31e3b4-edfa-437e-8149-a1f82bb978ce {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:26 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:26 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce 1073741824 Sep 28 17:14:26 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:26 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.1c0fbdcd-2a83-4c4f-8110-68cf386da404" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-1c0fbdcd-2a83-4c4f-8110-68cf386da404" released by "_delete_snapshot" :: held 2.622s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_snapshot" :: held 2.663s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Created reservations ['53c03bf2-1da6-4f0a-bdc8-3794c1732a4b', '2a1b00ac-337c-451b-bf4e-5532f1eeb169', '90dd9b78-e9d5-4186-a74f-066c91188136', '3b9365f4-35f5-42b2-b617-14aa230195dd'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Delete snapshot completed successfully. Sep 28 17:14:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0a548a40-b582-4285-bd1a-a87b443fac25 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-1c0fbdcd-2a83-4c4f-8110-68cf386da404-delete_snapshot" released by "delete_snapshot" :: held 2.996s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:27 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce 1073741824" returned: 0 in 0.887s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce Sep 28 17:14:27 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:27 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.089s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Creating offline snapshot 38913156-e565-4ce8-b645-e3492d9a5860 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f42ddd7f-7454-4e6f-b710-ff29d7607f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da31e3b4-edfa-437e-8149-a1f82bb978ce', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91217f17-ff7f-41ef-8573-e7e0997d6221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63dece0-5a3e-4e3d-90be-6a41594392db]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-da31e3b4-edfa-437e-8149-a1f82bb978ce (da31e3b4-edfa-437e-8149-a1f82bb978ce): created successfully Sep 28 17:14:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91217f17-ff7f-41ef-8573-e7e0997d6221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (3ad973e6-d630-46a2-a203-9f420a1547e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f08f7604-7847-4f76-ab70-7712f4cc43ad tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:28 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:28 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:28 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.772s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:28 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 1G Sep 28 17:14:28 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=202,cinder:SELECT=161,cinder:INSERT=49,cinder:DELETE=12 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (79a59b6a-2680-43ed-944f-ee7dd1cbd05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1652bf87-0e48-4ba8-b82a-5520067d2b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1652bf87-0e48-4ba8-b82a-5520067d2b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887036984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29366a6-0d41-4d88-982a-5cf543cc3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:29Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ea8602-b7da-47f9-acd9-d19ae626f8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ea8602-b7da-47f9-acd9-d19ae626f8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcd98f5-3eb9-4279-a740-59070cb5c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcd98f5-3eb9-4279-a740-59070cb5c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd29366a6-0d41-4d88-982a-5cf543cc3f19', 'volume_name': 'volume-d29366a6-0d41-4d88-982a-5cf543cc3f19', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcece56-7c2a-47a1-8445-69da92a85627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcece56-7c2a-47a1-8445-69da92a85627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaaca7a-3d5d-4f50-8352-de9da401cb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume d29366a6-0d41-4d88-982a-5cf543cc3f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d29366a6-0d41-4d88-982a-5cf543cc3f19', 'volume_size': 1} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:29 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 1G" returned: 0 in 0.977s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:29 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 Sep 28 17:14:29 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (b1cd2e1c-311e-4199-9753-a2c3fcd46296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5689ce-aa7a-46a3-8d37-98544b08dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:30 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae5689ce-aa7a-46a3-8d37-98544b08dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379825422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c6c0b1-b3cd-4c86-8dfd-008f3ddea230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:30Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e693c1ca-8f03-41f0-b948-a02c7451c219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e693c1ca-8f03-41f0-b948-a02c7451c219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f28932c-b2dd-4125-a780-a8e0e0b91919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f28932c-b2dd-4125-a780-a8e0e0b91919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22c6c0b1-b3cd-4c86-8dfd-008f3ddea230', 'volume_name': 'volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0366bc4d-d958-4a5c-b2af-08f47e698263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0366bc4d-d958-4a5c-b2af-08f47e698263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e080a8e7-3d81-44ed-a6ac-4c2fc1f13719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume 22c6c0b1-b3cd-4c86-8dfd-008f3ddea230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230', 'volume_size': 1} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860" returned: 0 in 0.622s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 is being set with open permissions: ugo+rw Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 Sep 28 17:14:30 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860" returned: 0 in 0.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.051s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-887036984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d29366a6-0d41-4d88-982a-5cf543cc3f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:29Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume d29366a6-0d41-4d88-982a-5cf543cc3f19 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:30 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:30 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 1073741824 Sep 28 17:14:30 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (ee88c5fe-cb24-4ae4-bdae-91f0e7dcf1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8512d4-98ce-4d81-a993-09c744901c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6a22c94a-209b-4d7b-bc81-7b22a03d51f5 tempest-SnapshotsActionsTest-796090136 None] Create snapshot completed successfully Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a8512d4-98ce-4d81-a993-09c744901c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996167247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7aaefc-bdcb-419f-bdb0-04bd7ad924c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137ae03e-bbfa-4d7c-b74f-cdd66f8c6859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137ae03e-bbfa-4d7c-b74f-cdd66f8c6859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9961a5-0def-406b-848a-f728df77de55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9961a5-0def-406b-848a-f728df77de55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7aaefc-bdcb-419f-bdb0-04bd7ad924c3', 'volume_name': 'volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d13ed32-cf8a-4c0d-b8a0-040928220179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d13ed32-cf8a-4c0d-b8a0-040928220179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461f35b9-8df2-428d-8efb-03cb6b3e4817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume da7aaefc-bdcb-419f-bdb0-04bd7ad924c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3', 'volume_size': 1} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (601019fe-9267-48e1-87bd-2e448d172d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e32ab-02a1-4b02-aa03-38710a18a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200e32ab-02a1-4b02-aa03-38710a18a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001871049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10af3f5-814d-4a0d-8bd0-9ee43de75601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2dadd4-c9d6-483a-9d67-91ae82075a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2dadd4-c9d6-483a-9d67-91ae82075a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf2e67a-f311-4539-afe2-b18e28f8b5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf2e67a-f311-4539-afe2-b18e28f8b5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a10af3f5-814d-4a0d-8bd0-9ee43de75601', 'volume_name': 'volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f86277c-fbc0-42cc-9d03-c3719bf72161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f86277c-fbc0-42cc-9d03-c3719bf72161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fed50e-29e0-418f-9788-51dd3d6c7e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume a10af3f5-814d-4a0d-8bd0-9ee43de75601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601', 'volume_size': 1} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:31 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 1073741824" returned: 0 in 0.887s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:31 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 Sep 28 17:14:31 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (bf7f0b3e-f1e1-42a0-9928-ab38596a884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45f9d72-fa0d-42fb-8a5f-7aa5590c353a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c45f9d72-fa0d-42fb-8a5f-7aa5590c353a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1970770882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f7fa20-1ea0-45bb-b30c-9671997d8fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda582a8-0a4d-4e95-96a4-887427e1b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda582a8-0a4d-4e95-96a4-887427e1b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fbcca-2e24-4d58-80cb-45a4c76175cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25fbcca-2e24-4d58-80cb-45a4c76175cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f7fa20-1ea0-45bb-b30c-9671997d8fe8', 'volume_name': 'volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca0605-80a1-4187-be41-85cd2809d7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca0605-80a1-4187-be41-85cd2809d7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3987b-fbe8-4c2c-b508-53e717776301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume a0f7fa20-1ea0-45bb-b30c-9671997d8fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8', 'volume_size': 1} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-38913156-e565-4ce8-b645-e3492d9a5860-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19" returned: 0 in 0.539s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-379825422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22c6c0b1-b3cd-4c86-8dfd-008f3ddea230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:30Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume 22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:32 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-38913156-e565-4ce8-b645-e3492d9a5860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:32 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 1073741824 Sep 28 17:14:32 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaaca7a-3d5d-4f50-8352-de9da401cb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d29366a6-0d41-4d88-982a-5cf543cc3f19', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae06363-ff3b-4233-a169-491c498fbabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_snapshot" :: waited 0.085s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-38913156-e565-4ce8-b645-e3492d9a5860" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 (d29366a6-0d41-4d88-982a-5cf543cc3f19): created successfully Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae06363-ff3b-4233-a169-491c498fbabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (79a59b6a-2680-43ed-944f-ee7dd1cbd05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-38913156-e565-4ce8-b645-e3492d9a5860" acquired by "_delete_snapshot" :: waited 0.119s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Deleting offline snapshot 38913156-e565-4ce8-b645-e3492d9a5860 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] snapshot_file for this snap is: volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-993775c8-e78a-48c8-8405-11c3eb653e84 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a318612b-c99f-4510-a718-6b443bf46a4a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:32 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 Sep 28 17:14:32 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 1073741824" returned: 0 in 0.831s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 Sep 28 17:14:33 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860" returned: 0 in 0.708s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7648f4-08a1-46c3-beb8-989d5c5737ba]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" returned: 0 in 0.544s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:33 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:33 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1996167247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7aaefc-bdcb-419f-bdb0-04bd7ad924c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:33 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e080a8e7-3d81-44ed-a6ac-4c2fc1f13719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da283e87-c211-46b2-8cd9-ddf9157a6eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:33 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 1073741824 Sep 28 17:14:33 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 (22c6c0b1-b3cd-4c86-8dfd-008f3ddea230): created successfully Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da283e87-c211-46b2-8cd9-ddf9157a6eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (b1cd2e1c-311e-4199-9753-a2c3fcd46296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-35881ddc-d12d-4b55-a734-9fac53310bd5 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:34 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.831s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:34 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 Sep 28 17:14:34 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 1073741824" returned: 0 in 1.219s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 Sep 28 17:14:35 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860" returned: 0 in 0.920s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860 Sep 28 17:14:35 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" returned: 0 in 0.483s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.951s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001871049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10af3f5-814d-4a0d-8bd0-9ee43de75601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:31Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume a10af3f5-814d-4a0d-8bd0-9ee43de75601 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:35 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:35 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.38913156-e565-4ce8-b645-e3492d9a5860" returned: 0 in 0.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:35 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 1073741824 Sep 28 17:14:35 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (461f35b9-8df2-428d-8efb-03cb6b3e4817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96995f-00a0-400a-9d1a-b2a1444e51f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 (da7aaefc-bdcb-419f-bdb0-04bd7ad924c3): created successfully Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b96995f-00a0-400a-9d1a-b2a1444e51f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (ee88c5fe-cb24-4ae4-bdae-91f0e7dcf1ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-38913156-e565-4ce8-b645-e3492d9a5860" released by "_delete_snapshot" :: held 3.190s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_snapshot" :: held 3.325s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-edd28e48-3008-4340-8525-994b8909c48c tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:35 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Created reservations ['d21f3b5a-76c8-4668-9189-e77c9a2d62fd', '0b961c6c-7081-493a-bec2-14875f30202f', 'e8902dee-5908-4c58-8b2a-5aed1ccd86d2', '576634ac-bbf2-4db3-9c0f-5ad1b2d1c937'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:36 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Delete snapshot completed successfully. Sep 28 17:14:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e1b244f9-2120-4985-9350-ad1396692380 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-38913156-e565-4ce8-b645-e3492d9a5860-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:36 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 1073741824" returned: 0 in 0.733s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:36 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 Sep 28 17:14:36 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:36 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601" returned: 0 in 0.544s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.680s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1970770882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f7fa20-1ea0-45bb-b30c-9671997d8fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f55f975fb7ae406db112533625a3be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:32Z,use_quota=True,user_id='a863ed371cf74888955429ab78458566',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Creating volume a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:37 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:37 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 1073741824 Sep 28 17:14:37 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66fed50e-29e0-418f-9788-51dd3d6c7e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b93ead-b116-40c6-a14c-a56ca47350ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:37 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 (a10af3f5-814d-4a0d-8bd0-9ee43de75601): created successfully Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b93ead-b116-40c6-a14c-a56ca47350ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (601019fe-9267-48e1-87bd-2e448d172d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:37 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1d187400-5175-45a1-b7ea-923e71c3dc36 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:37 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 1073741824" returned: 0 in 0.951s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 Sep 28 17:14:38 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:38 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1a3987b-fbe8-4c2c-b508-53e717776301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b278ad1a-eae3-4829-8cbc-b6fb7d5f4a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Creating offline snapshot 92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:14:38 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Volume volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 (a0f7fa20-1ea0-45bb-b30c-9671997d8fe8): created successfully Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b278ad1a-eae3-4829-8cbc-b6fb7d5f4a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Flow 'volume_create_manager' (bf7f0b3e-f1e1-42a0-9928-ab38596a884a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3fd79-f9af-493f-91ea-1739a4a6d8b2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7c79da59-03cb-4a5e-829a-f741f61bc201 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created volume successfully. Sep 28 17:14:38 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:38 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.577s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[99113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e 1G Sep 28 17:14:39 devstack sudo[99113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" acquired by "delete_volume" :: waited 0.051s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f8ebb0-1c9b-4d5e-a460-e3a5dfaac034]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:39 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 Sep 28 17:14:39 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[99113]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e 1G" returned: 0 in 1.048s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e Sep 28 17:14:40 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" returned: 0 in 0.906s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=161,cinder:UPDATE=195,cinder:INSERT=45,cinder:DELETE=13 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:14:40 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8 Sep 28 17:14:40 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (7559587e-37af-4909-adae-04bcf5187d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc85eef-251f-41e1-8307-65582d3d2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cc85eef-251f-41e1-8307-65582d3d2234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134853636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f552b57d-3150-4296-a695-a1789c7d0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:41Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7efd19-0b2b-40bf-9276-43d7c735a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7efd19-0b2b-40bf-9276-43d7c735a29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5e0286-71cf-4fae-98f1-4901f2a47534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5e0286-71cf-4fae-98f1-4901f2a47534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f552b57d-3150-4296-a695-a1789c7d0bde', 'volume_name': 'volume-f552b57d-3150-4296-a695-a1789c7d0bde', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01336545-5d9b-46d3-bd1f-e4872a7cc65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01336545-5d9b-46d3-bd1f-e4872a7cc65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad05b94-2186-4461-84d2-da0796914a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:40 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Volume f552b57d-3150-4296-a695-a1789c7d0bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f552b57d-3150-4296-a695-a1789c7d0bde', 'volume_size': 1} Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:40 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" returned: 0 in 0.617s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:40 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e is being set with open permissions: ugo+rw Sep 28 17:14:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:40 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e Sep 28 17:14:40 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" returned: 0 in 0.426s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8" released by "delete_volume" :: held 1.420s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['67039a9c-bbea-4be0-84ea-93518bcd7f26', '87692a8f-f481-4f47-8308-2b919903908a', '5db16507-de93-48e3-b77c-f50c8f34274f', 'd814c14f-3f30-4cfe-bec5-ef8ad2bc3da1'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:41 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" returned: 0 in 0.447s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2134853636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f552b57d-3150-4296-a695-a1789c7d0bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:41Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Creating volume f552b57d-3150-4296-a695-a1789c7d0bde {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:41 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde 1073741824 Sep 28 17:14:41 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ec74a929-d0c2-4c3e-98ef-63b56f07601d tempest-SnapshotsActionsTest-796090136 None] Create snapshot completed successfully Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:41 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:41 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:41 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5193b91-6776-441e-84a5-8e842715aa44 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-a0f7fa20-1ea0-45bb-b30c-9671997d8fe8-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-a10af3f5-814d-4a0d-8bd0-9ee43de75601-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-a10af3f5-814d-4a0d-8bd0-9ee43de75601-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Acquiring lock "cinder-quobyte-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:42 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde 1073741824" returned: 0 in 0.883s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-a10af3f5-814d-4a0d-8bd0-9ee43de75601" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Deleting offline snapshot 92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] snapshot_file for this snap is: volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-a10af3f5-814d-4a0d-8bd0-9ee43de75601" acquired by "delete_volume" :: waited 0.056s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d631b7-8dd1-438b-8ffd-7d0575a669cb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b797f23-b1d0-4905-92db-9b410ddb0550]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:42 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde Sep 28 17:14:42 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e Sep 28 17:14:42 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 Sep 28 17:14:42 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:42 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601" returned: 0 in 0.579s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" returned: 0 in 0.630s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:43 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601 Sep 28 17:14:43 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:43 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde" returned: 0 in 0.620s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[634dcc1a-1493-4cec-8e8f-63103d543dec]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad05b94-2186-4461-84d2-da0796914a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f552b57d-3150-4296-a695-a1789c7d0bde', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d03b65-3a8e-42ea-aa12-7eada24033e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Volume volume-f552b57d-3150-4296-a695-a1789c7d0bde (f552b57d-3150-4296-a695-a1789c7d0bde): created successfully Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d03b65-3a8e-42ea-aa12-7eada24033e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (7559587e-37af-4909-adae-04bcf5187d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f49757df-98e8-4c14-88fb-0b400e87c216 tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:14:43 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:43 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:43 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a10af3f5-814d-4a0d-8bd0-9ee43de75601" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-a10af3f5-814d-4a0d-8bd0-9ee43de75601" released by "delete_volume" :: held 1.166s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['22e90bcd-9783-4b62-9db2-4349a45c3be6', '9dccea25-19c0-415c-a290-0d2e343e8336', '5ce3e849-903f-4026-9f95-7251e6e15c45', '7ef9f20c-ca09-478c-8c9c-a02da2fd0f05'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:43 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.722s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:43 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:43 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:43 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e Sep 28 17:14:43 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7979a1b0-040a-46a0-8f6a-fadb4e897ddc tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde" by "attach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7979a1b0-040a-46a0-8f6a-fadb4e897ddc tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde" acquired by "attach_volume" :: waited 0.064s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.489s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b5819232-69e0-4f1f-a595-6d3ddc849295 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-a10af3f5-814d-4a0d-8bd0-9ee43de75601-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7979a1b0-040a-46a0-8f6a-fadb4e897ddc tempest-VolumesActionsTest-970549374 None] Attaching volume f552b57d-3150-4296-a695-a1789c7d0bde to instance 2c86cc66-d64c-4c0e-a1f1-96a70cba7295 at mountpoint /dev/vdb on host None. Sep 28 17:14:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7979a1b0-040a-46a0-8f6a-fadb4e897ddc tempest-VolumesActionsTest-970549374 None] Attach volume completed successfully. Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7979a1b0-040a-46a0-8f6a-fadb4e897ddc tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde" released by "attach_volume" :: held 0.298s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" returned: 0 in 0.967s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:44 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e Sep 28 17:14:44 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" acquired by "delete_volume" :: waited 0.046s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fc6a43-6e43-45cc-b437-cbd0c70918e5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:45 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 Sep 28 17:14:45 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" returned: 0 in 0.715s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e" released by "_delete_snapshot" :: held 3.282s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_snapshot" :: held 3.338s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Terminate volume connection completed successfully. Sep 28 17:14:45 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" by "detach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" returned: 0 in 0.797s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Created reservations ['490301de-a022-4e5b-83bb-1205778eaf38', 'd5e42997-dff2-405e-a7b6-dabeddd57f0b', 'd25ad7f7-aaad-4037-b686-622e4e357755', 'f0e083f0-3335-4e53-8001-74231ac4ec8e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:45 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3 Sep 28 17:14:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" acquired by "detach_volume" :: waited 0.068s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:45 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Detaching volume f552b57d-3150-4296-a695-a1789c7d0bde from instance 2c86cc66-d64c-4c0e-a1f1-96a70cba7295. Sep 28 17:14:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Delete snapshot completed successfully. Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-22513a78-828d-40a7-9aca-a4be73569513 tempest-SnapshotsActionsTest-1578593233 None] Lock "cinder-92f7eac4-bd7f-4f5d-b9ab-9a1c4db87f4e-delete_snapshot" released by "delete_snapshot" :: held 3.802s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Detach volume completed successfully. Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-181c5f5f-f192-43dd-88b7-3b03b0b38dca tempest-VolumesActionsTest-261576784 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" released by "detach_volume" :: held 0.229s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:46 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3" released by "delete_volume" :: held 1.353s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['f4aba7e6-b1be-49a9-9b9c-56b70f6c19fa', 'd30069ef-a55a-4cca-b9af-1ea07a35eed2', '4c5c8f55-a4d1-471d-9a69-a4989a5bd681', '10a50781-7395-49b5-b027-97832bd49ddd'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-278b01e7-89fc-42a2-b910-e445b987ce6f tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" by "detach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-278b01e7-89fc-42a2-b910-e445b987ce6f tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-278b01e7-89fc-42a2-b910-e445b987ce6f tempest-VolumesActionsTest-970549374 None] Volume detach called, but volume not attached. Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:46 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:46 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-278b01e7-89fc-42a2-b910-e445b987ce6f tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-quobyte-f552b57d-3150-4296-a695-a1789c7d0bde" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "cinder-quobyte-f552b57d-3150-4296-a695-a1789c7d0bde" acquired by "delete_volume" :: waited 0.118s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:47 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 1.076s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230-delete_volume" acquired by "delete_volume" :: waited 0.188s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[60caf455-3ffa-4cfa-a7e9-4b4a46e67958]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e657d887-f6e5-4da6-9a63-4a7cc9d339c1 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-da7aaefc-bdcb-419f-bdb0-04bd7ad924c3-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" acquired by "delete_volume" :: waited 0.062s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde Sep 28 17:14:48 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa74715-07b3-4393-813c-e350b27a73ae]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "cinder-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "cinder-quobyte-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:48 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 Sep 28 17:14:48 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Deleting offline snapshot c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 of volume 5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] snapshot_file for this snap is: volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36f829a-395a-4438-a71f-d3dff0bc172a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde" returned: 0 in 1.270s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:48 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:48 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:48 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde Sep 28 17:14:49 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" returned: 0 in 1.123s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230 Sep 28 17:14:49 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:49 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f552b57d-3150-4296-a695-a1789c7d0bde" returned: 0 in 0.612s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.837s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5167e395-a8ba-4208-abe6-53422e21cc73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "cinder-quobyte-f552b57d-3150-4296-a695-a1789c7d0bde" released by "delete_volume" :: held 2.141s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f8a76e-7097-4e32-a869-b0a060664476]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:49 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" returned: 0 in 0.561s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230" released by "delete_volume" :: held 1.785s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:49 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Created reservations ['df30e36a-e0bd-4bef-93b5-c407db74e90f', '60344b13-7321-45d5-8fa9-0e9a5f07e50f', '3191dbad-10b1-4233-a125-28671c88e4a1', 'faaa4ccd-b2c9-49ed-b9b0-6889b61c96d8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:49 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 Sep 28 17:14:49 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['59fadbab-3c0e-4f90-8673-475cea5a022f', '7ce11a67-7080-4648-b1b1-d514b375874c', '668c1e66-1423-4f48-9709-0271b1184404', '9a0e337c-8d1a-42a2-81bd-4e89df3983de'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:50 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:50 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:50 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:50 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73" returned: 0 in 0.901s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:50 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:50 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:50 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.691s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:50 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Deleted volume successfully. Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9d6753c0-d206-4d73-a34e-a22b8b0cc1cc tempest-VolumesActionsTest-970549374 None] Lock "cinder-f552b57d-3150-4296-a695-a1789c7d0bde-delete_volume" released by "delete_volume" :: held 3.846s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:51 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.769s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-d29366a6-0d41-4d88-982a-5cf543cc3f19-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:51 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.771s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-bdabf802-0259-45e6-bc05-fbf86307275d tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-22c6c0b1-b3cd-4c86-8dfd-008f3ddea230-delete_volume" released by "delete_volume" :: held 3.752s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:51 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9 Sep 28 17:14:51 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-d29366a6-0d41-4d88-982a-5cf543cc3f19-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-d29366a6-0d41-4d88-982a-5cf543cc3f19" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-d29366a6-0d41-4d88-982a-5cf543cc3f19" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3668588-6c1a-4029-9694-a05a8d0f3ef4]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:51 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 Sep 28 17:14:51 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:51 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73.c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" returned: 0 in 0.607s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9" released by "_delete_snapshot" :: held 3.374s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_snapshot" :: held 3.432s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Created reservations ['d9a8500e-48b0-43ac-82df-cfb993fd3b71', 'c0f00eb9-5869-488c-aea1-5afff77ea46a', 'c8f554ee-643b-4542-8156-7bd9cd81e063', 'cf6050fb-6b7c-4e40-b622-898483222d43'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:52 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19" returned: 0 in 0.678s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:52 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19 Sep 28 17:14:52 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Delete snapshot completed successfully. Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10683f7f-f755-4113-ab78-908240d077ca tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-c8bbee95-7d87-4ec8-876a-46f6bd1b6ab9-delete_snapshot" released by "delete_snapshot" :: held 3.750s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d29366a6-0d41-4d88-982a-5cf543cc3f19" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-d29366a6-0d41-4d88-982a-5cf543cc3f19" released by "delete_volume" :: held 1.140s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['9d7d9481-8516-49e0-aa48-55e442f6e2f3', '18db86fe-b1da-4787-af41-9f6e5fed96f9', '839bd073-9377-4f98-bdea-e6691a9b0a1a', 'dec1597d-dde6-4e5d-88dc-77a70698a0f8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:52 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:52 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "cinder-5167e395-a8ba-4208-abe6-53422e21cc73-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-5167e395-a8ba-4208-abe6-53422e21cc73-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3dcbb3-e855-444f-a310-0c217575aed9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:53 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.722s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f3ca2f0d-d477-4587-92d5-6bd674337831 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-d29366a6-0d41-4d88-982a-5cf543cc3f19-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-da31e3b4-edfa-437e-8149-a1f82bb978ce-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-da31e3b4-edfa-437e-8149-a1f82bb978ce-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 Sep 28 17:14:53 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "cinder-quobyte-da31e3b4-edfa-437e-8149-a1f82bb978ce" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-da31e3b4-edfa-437e-8149-a1f82bb978ce" acquired by "delete_volume" :: waited 0.046s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[35609f08-2faa-47e8-befe-38ebb9f33d26]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce Sep 28 17:14:54 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73" returned: 0 in 0.716s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73 Sep 28 17:14:54 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce" returned: 0 in 0.684s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:54 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce Sep 28 17:14:54 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:54 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5167e395-a8ba-4208-abe6-53422e21cc73" returned: 0 in 0.483s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-quobyte-5167e395-a8ba-4208-abe6-53422e21cc73" released by "delete_volume" :: held 1.354s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Created reservations ['814e85c5-031b-479b-b066-044b05ccd291', 'b81b8d33-b2c1-4d6c-b07b-dc3c750fbdb0', '5fc364d0-0d34-4699-92b0-544501012dac', '73298fc3-bd9a-4db8-ab1b-644a02e6fd73'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:55 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-da31e3b4-edfa-437e-8149-a1f82bb978ce" returned: 0 in 0.516s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-quobyte-da31e3b4-edfa-437e-8149-a1f82bb978ce" released by "delete_volume" :: held 1.290s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Created reservations ['3993ed88-9317-4dbf-977d-6387ef138057', '0c7199b8-3fa8-437f-9a08-bd94315d257a', '313e2bb6-ecd3-4895-9d9c-83a7dddf6318', '2c2cfeea-61be-467a-bd96-2b017ce2e8b9'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (8a8fb33b-4924-4ca8-b4c5-56eb2a33aeee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1229479e-2514-47bb-9cc5-e74223aad982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1229479e-2514-47bb-9cc5-e74223aad982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1579398116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2757e26d-8a1d-492c-80f1-df4b0b755507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:55Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74107523-57a9-4f10-a19b-d4d09ae269d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74107523-57a9-4f10-a19b-d4d09ae269d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b323a026-d9a8-43ba-a22f-2be69c30e6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b323a026-d9a8-43ba-a22f-2be69c30e6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2757e26d-8a1d-492c-80f1-df4b0b755507', 'volume_name': 'volume-2757e26d-8a1d-492c-80f1-df4b0b755507', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb86bf2-595e-4b62-aacb-bf8395fe15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb86bf2-595e-4b62-aacb-bf8395fe15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd5bb3-1942-4928-a7ff-598a192e8b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:55 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Volume 2757e26d-8a1d-492c-80f1-df4b0b755507: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2757e26d-8a1d-492c-80f1-df4b0b755507', 'volume_size': 1} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1579398116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2757e26d-8a1d-492c-80f1-df4b0b755507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:55Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Creating volume 2757e26d-8a1d-492c-80f1-df4b0b755507 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:14:55 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.387s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 1073741824 Sep 28 17:14:55 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Deleted volume successfully. Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-634381f8-dc8a-4c12-8c4d-83ab1ddd146a tempest-SnapshotsActionsTest-796090136 None] Lock "cinder-5167e395-a8ba-4208-abe6-53422e21cc73-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:55 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:55 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:55 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.368s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Deleted volume successfully. Sep 28 17:14:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d2525faf-df43-4bb0-a646-cb322f276a43 tempest-CreateVolumesFromSourceVolumeTest-1995882284 None] Lock "cinder-da31e3b4-edfa-437e-8149-a1f82bb978ce-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:56 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 1073741824" returned: 0 in 0.687s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:56 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 Sep 28 17:14:56 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:56 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bd5bb3-1942-4928-a7ff-598a192e8b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2757e26d-8a1d-492c-80f1-df4b0b755507', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6589afed-46dd-4b82-a463-810bacfaca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:56 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Volume volume-2757e26d-8a1d-492c-80f1-df4b0b755507 (2757e26d-8a1d-492c-80f1-df4b0b755507): created successfully Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6589afed-46dd-4b82-a463-810bacfaca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (8a8fb33b-4924-4ca8-b4c5-56eb2a33aeee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:56 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-63e9e0f7-bb3b-416b-96dd-1a0c8dcd7e58 tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-2757e26d-8a1d-492c-80f1-df4b0b755507-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "cinder-2757e26d-8a1d-492c-80f1-df4b0b755507-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-quobyte-2757e26d-8a1d-492c-80f1-df4b0b755507" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-2757e26d-8a1d-492c-80f1-df4b0b755507" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef1d84a-8dba-43c1-b6ce-40bdc7f071cf]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:57 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 Sep 28 17:14:57 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Flow 'volume_create_manager' (7c4c32a1-4f33-4fbd-b3a2-a995930168dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adb0c06-c71e-4697-be86-235da63c147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adb0c06-c71e-4697-be86-235da63c147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-770945599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442143bb-d67b-4fad-947a-0abed4e15783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1b132f4a445fea82a7bc219633bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:58Z,use_quota=True,user_id='b32078174852464a82eced40c69ee093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6633df-5bdb-4d07-856f-01a1215db3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6633df-5bdb-4d07-856f-01a1215db3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db84b47a-a0e2-4448-b793-53bf5aaa6766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:14:58 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507" returned: 0 in 0.553s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507 Sep 28 17:14:58 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:58 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2757e26d-8a1d-492c-80f1-df4b0b755507" returned: 0 in 0.323s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-2757e26d-8a1d-492c-80f1-df4b0b755507" released by "delete_volume" :: held 0.965s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Created reservations ['9567ca3c-8090-4ff9-94a6-fdd5d9c82ba5', 'a34c1d03-f6a7-4c63-b14f-a8cf5d901c42', '780f8aa2-82db-44af-ba3e-01411c37ede8', 'a092e2d4-b8c1-440a-a3c0-16ed088ccf83'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:14:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:14:58 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:14:58 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db84b47a-a0e2-4448-b793-53bf5aaa6766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '442143bb-d67b-4fad-947a-0abed4e15783', 'volume_name': 'volume-442143bb-d67b-4fad-947a-0abed4e15783', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1029a32-048d-4c12-a285-95607a9f103e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1029a32-048d-4c12-a285-95607a9f103e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81156c7-feca-4cbb-b0a8-47a25142411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:14:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Volume 442143bb-d67b-4fad-947a-0abed4e15783: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-442143bb-d67b-4fad-947a-0abed4e15783', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Trying to clone 442143bb-d67b-4fad-947a-0abed4e15783 from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de at location (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:14:59 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.508s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:14:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Deleted volume successfully. Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c522916-9146-4c6e-b8a6-1dbd09a9b41f tempest-VolumesActionsTest-261576784 None] Lock "cinder-2757e26d-8a1d-492c-80f1-df4b0b755507-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:14:59 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b65bb14-9d06-41ae-8f20-05482cd3d6ec]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:14:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD Sep 28 17:15:00 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:00 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de is fetched for user b32078174852464a82eced40c69ee093. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5af0cc-333d-4630-a5de-b8648607ba41]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (e358b679-0b6f-45cc-9016-b1053e648926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e7b28-0e57-4f31-8e8b-1d528c5d45a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD Sep 28 17:15:00 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (859e7b28-0e57-4f31-8e8b-1d528c5d45a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243790740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db92fe42-a631-4914-a33a-fc17977eb78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:01Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566d6222-439d-4328-b1f7-d83004b5bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566d6222-439d-4328-b1f7-d83004b5bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6557d453-44b4-4819-844b-4b53b4601168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6557d453-44b4-4819-844b-4b53b4601168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db92fe42-a631-4914-a33a-fc17977eb78a', 'volume_name': 'volume-db92fe42-a631-4914-a33a-fc17977eb78a', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df8ff04-69c4-4b53-85e3-6f9954b3bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df8ff04-69c4-4b53-85e3-6f9954b3bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feda82a-0ed5-438e-82c6-52becdfcd883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:00 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Volume db92fe42-a631-4914-a33a-fc17977eb78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db92fe42-a631-4914-a33a-fc17977eb78a', 'volume_size': 1} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1243790740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db92fe42-a631-4914-a33a-fc17977eb78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:01Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Creating volume db92fe42-a631-4914-a33a-fc17977eb78a {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:00 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:00 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a 1073741824 Sep 28 17:15:00 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:01 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a 1073741824" returned: 0 in 0.590s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a Sep 28 17:15:01 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a" returned: 0 in 0.332s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.673s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-770945599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442143bb-d67b-4fad-947a-0abed4e15783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd1b132f4a445fea82a7bc219633bd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:14:58Z,use_quota=True,user_id='b32078174852464a82eced40c69ee093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Creating volume 442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2feda82a-0ed5-438e-82c6-52becdfcd883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db92fe42-a631-4914-a33a-fc17977eb78a', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:01 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1073741824 Sep 28 17:15:01 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa417c86-9eec-47ce-acb1-8db68cc4fedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Volume volume-db92fe42-a631-4914-a33a-fc17977eb78a (db92fe42-a631-4914-a33a-fc17977eb78a): created successfully Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa417c86-9eec-47ce-acb1-8db68cc4fedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (e358b679-0b6f-45cc-9016-b1053e648926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-137455d4-1d60-4ba2-b41c-94d297a6a514 tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:15:02 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1073741824" returned: 0 in 0.604s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:02 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 Sep 28 17:15:02 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:02 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783" returned: 0 in 0.373s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Attempting download of 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 442143bb-d67b-4fad-947a-0abed4e15783. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9ba97-256b-4eaa-9095-46304a889b7b]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-db92fe42-a631-4914-a33a-fc17977eb78a-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "cinder-db92fe42-a631-4914-a33a-fc17977eb78a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-quobyte-db92fe42-a631-4914-a33a-fc17977eb78a" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-db92fe42-a631-4914-a33a-fc17977eb78a" acquired by "delete_volume" :: waited 0.061s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccc19d6-9c80-4c31-9a65-39829bad91b6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe Sep 28 17:15:03 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a Sep 28 17:15:03 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe" returned: 0 in 0.583s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a" returned: 0 in 0.571s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:03 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe Sep 28 17:15:03 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:03 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a Sep 28 17:15:03 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-db92fe42-a631-4914-a33a-fc17977eb78a" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe" returned: 1 in 0.673s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_dc1hrrqe' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-db92fe42-a631-4914-a33a-fc17977eb78a" released by "delete_volume" :: held 1.075s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a626a-cbf1-403b-9227-5003bd35d77c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Created reservations ['27337df6-4cae-40d7-a342-271a8a724690', '4c4b7d0a-c4f0-4141-abce-851e276d7992', 'f4a1fe9f-2ded-4ded-b894-efbfc40018c2', 'ad53b0c6-6e6b-4200-ba10-5c1bfa8929fc'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:04 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD Sep 28 17:15:04 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:04 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] 40f838d7-edca-40ca-9cfd-7bbe1f3736de was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:04 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 Sep 28 17:15:04 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:04 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.488s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:04 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Deleted volume successfully. Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f6ce66d5-a901-440e-a75a-3e0bda5c566f tempest-VolumesActionsTest-261576784 None] Lock "cinder-db92fe42-a631-4914-a33a-fc17977eb78a-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Flow 'volume_create_manager' (b5079d7e-ead6-4382-8bc1-587295dfd0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc479902-e8ab-481b-9aff-6d6b21dda888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc479902-e8ab-481b-9aff-6d6b21dda888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1937463208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29870d41-6eda-45f5-9487-a71e1d4660b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d448e80ae5474554ac7fac748807162f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:05Z,use_quota=True,user_id='2ffc99e2c5034bcdad6be8402797f3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c67fee-3007-4d22-93c5-0466c4410fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c67fee-3007-4d22-93c5-0466c4410fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c299f5-445f-459e-bb4a-f5a4b318bce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c299f5-445f-459e-bb4a-f5a4b318bce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29870d41-6eda-45f5-9487-a71e1d4660b0', 'volume_name': 'volume-29870d41-6eda-45f5-9487-a71e1d4660b0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16eec9c-e89e-4147-824a-cf3b5658cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16eec9c-e89e-4147-824a-cf3b5658cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c79f7-1aa3-4b07-835f-713349856f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Volume 29870d41-6eda-45f5-9487-a71e1d4660b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29870d41-6eda-45f5-9487-a71e1d4660b0', 'volume_size': 1} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1937463208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29870d41-6eda-45f5-9487-a71e1d4660b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d448e80ae5474554ac7fac748807162f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:05Z,use_quota=True,user_id='2ffc99e2c5034bcdad6be8402797f3af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Creating volume 29870d41-6eda-45f5-9487-a71e1d4660b0 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:05 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:05 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 1073741824 Sep 28 17:15:05 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Flow 'volume_create_manager' (b84cab0b-8e21-462b-978f-d16e1dae530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d053efe4-1ee5-4ede-9348-a8403ca8e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d053efe4-1ee5-4ede-9348-a8403ca8e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a669bc9f-d386-435b-9a5d-38d635c2fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3543e52ea81436ab15588c52fe98cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:05Z,use_quota=True,user_id='e05855e95b874257a8c813020c9643b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25278ef-cdb5-40e8-addc-efff6d6ebffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25278ef-cdb5-40e8-addc-efff6d6ebffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7c209-299e-472b-876a-58be431c4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (82ad5939-a8fb-4b14-b7cd-4105a171882b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60ad058-0b2f-416b-8ebe-d53758f53233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60ad058-0b2f-416b-8ebe-d53758f53233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014379238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34124316-b712-4a6c-96aa-a6bf78a0173b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:06Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547748a5-e617-4cad-b01c-b4af52365cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (547748a5-e617-4cad-b01c-b4af52365cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7dec77-4fcc-41b8-8254-e0d191504619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7dec77-4fcc-41b8-8254-e0d191504619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34124316-b712-4a6c-96aa-a6bf78a0173b', 'volume_name': 'volume-34124316-b712-4a6c-96aa-a6bf78a0173b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508d6c6-ab43-4a4c-bd29-7a5ddaff0d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b508d6c6-ab43-4a4c-bd29-7a5ddaff0d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96732fd2-cf89-454c-a20f-43b4c78c4212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Volume 34124316-b712-4a6c-96aa-a6bf78a0173b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34124316-b712-4a6c-96aa-a6bf78a0173b', 'volume_size': 1} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fca7c209-299e-472b-876a-58be431c4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a669bc9f-d386-435b-9a5d-38d635c2fc54', 'volume_name': 'volume-a669bc9f-d386-435b-9a5d-38d635c2fc54', 'volume_size': 1, 'image_id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '680f0af12856359cbb9871d0c8483684', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3543e52ea81436ab15588c52fe98cc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d37313f1752d62d7e935005ebac454c5fd27f182951c4b10ff26f271cb478a5d89069e00b08d8c4a645b09c7af71884060a0bbde0d466cf6b8089e981d4e2d9', 'id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f97d9655-73e3-49b5-a685-a1b5a7129cec/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98179d7-b82e-4d9c-89ee-669e2e4ed3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98179d7-b82e-4d9c-89ee-669e2e4ed3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af3d99-370d-4585-85d9-70044223a584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Volume a669bc9f-d386-435b-9a5d-38d635c2fc54: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a669bc9f-d386-435b-9a5d-38d635c2fc54', 'volume_size': 1, 'image_id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '680f0af12856359cbb9871d0c8483684', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3543e52ea81436ab15588c52fe98cc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d37313f1752d62d7e935005ebac454c5fd27f182951c4b10ff26f271cb478a5d89069e00b08d8c4a645b09c7af71884060a0bbde0d466cf6b8089e981d4e2d9', 'id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f97d9655-73e3-49b5-a685-a1b5a7129cec/file', 'properties': {}}, 'image_service': } Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Trying to clone a669bc9f-d386-435b-9a5d-38d635c2fc54 from image f97d9655-73e3-49b5-a685-a1b5a7129cec at location (None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:15:06 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 1073741824" returned: 0 in 0.656s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 Sep 28 17:15:06 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:15:06 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced9e46-8ad2-45ea-8ca7-f50d8ec716a6]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:06 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0" returned: 0 in 0.349s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.715s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2014379238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34124316-b712-4a6c-96aa-a6bf78a0173b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:06Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Creating volume 34124316-b712-4a6c-96aa-a6bf78a0173b {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:06 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b 1073741824 Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7c79f7-1aa3-4b07-835f-713349856f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29870d41-6eda-45f5-9487-a71e1d4660b0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:06 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0e3a06-57ca-4f93-bc7e-1b6619cdf4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Volume volume-29870d41-6eda-45f5-9487-a71e1d4660b0 (29870d41-6eda-45f5-9487-a71e1d4660b0): created successfully Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0e3a06-57ca-4f93-bc7e-1b6619cdf4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Flow 'volume_create_manager' (b5079d7e-ead6-4382-8bc1-587295dfd0ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-12700ca8-1c28-44f9-a4d8-ab0a56fefd6b tempest-VolumesServicesTestJSON-919956262 None] Created volume successfully. Sep 28 17:15:06 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 0 in 0.487s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:06 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:06 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b 1073741824" returned: 0 in 0.677s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 1 in 0.424s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Temporary image f97d9655-73e3-49b5-a685-a1b5a7129cec is fetched for user e05855e95b874257a8c813020c9643b7. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b Sep 28 17:15:07 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa47294-092e-45d2-8a3e-59d701faa0c0]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Acquiring lock "cinder-29870d41-6eda-45f5-9487-a71e1d4660b0-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "cinder-29870d41-6eda-45f5-9487-a71e1d4660b0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:07 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Acquiring lock "cinder-quobyte-29870d41-6eda-45f5-9487-a71e1d4660b0" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:07 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783" returned: 0 in 2.678s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_s5v014vtdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:07 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Converted 112.00 MB image at 41.82 MB/s Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "cinder-quobyte-29870d41-6eda-45f5-9487-a71e1d4660b0" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52ff5e4-455e-4905-bf99-430df538d2ef]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:07 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1G Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b" returned: 0 in 0.327s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96732fd2-cf89-454c-a20f-43b4c78c4212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34124316-b712-4a6c-96aa-a6bf78a0173b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ad012f-a7a8-4bd6-b713-b08c9ec27260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Volume volume-34124316-b712-4a6c-96aa-a6bf78a0173b (34124316-b712-4a6c-96aa-a6bf78a0173b): created successfully Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ad012f-a7a8-4bd6-b713-b08c9ec27260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (82ad5939-a8fb-4b14-b7cd-4105a171882b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9d7c71a9-47da-46b1-8949-9ad2886c5f0d tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:15:07 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 Sep 28 17:15:07 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 0 in 0.510s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:07 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:07 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-34124316-b712-4a6c-96aa-a6bf78a0173b-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:07 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 1G" returned: 0 in 0.479s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Downloaded image 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 442143bb-d67b-4fad-947a-0abed4e15783 successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de for user b32078174852464a82eced40c69ee093 is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Marking volume 442143bb-d67b-4fad-947a-0abed4e15783 as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Copying metadata from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de to 442143bb-d67b-4fad-947a-0abed4e15783. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Creating volume glance metadata for volume 442143bb-d67b-4fad-947a-0abed4e15783 backed by image 40f838d7-edca-40ca-9cfd-7bbe1f3736de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:15:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "cinder-34124316-b712-4a6c-96aa-a6bf78a0173b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-quobyte-34124316-b712-4a6c-96aa-a6bf78a0173b" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-34124316-b712-4a6c-96aa-a6bf78a0173b" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:08 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0" returned: 0 in 0.621s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c82caab-e585-48cc-9ee1-ac69f8bc9deb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0 Sep 28 17:15:08 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81156c7-feca-4cbb-b0a8-47a25142411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442143bb-d67b-4fad-947a-0abed4e15783', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3749c52-7e36-4734-8ad2-2c937e1a11b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Volume volume-442143bb-d67b-4fad-947a-0abed4e15783 (442143bb-d67b-4fad-947a-0abed4e15783): created successfully Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3749c52-7e36-4734-8ad2-2c937e1a11b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Flow 'volume_create_manager' (7c4c32a1-4f33-4fbd-b3a2-a995930168dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1da47053-4290-44aa-9e25-07821d0eb76e tempest-VolumesImageMetadata-1851800345 None] Created volume successfully. Sep 28 17:15:08 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b Sep 28 17:15:08 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 1 in 0.529s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a669bc9f-d386-435b-9a5d-38d635c2fc54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3543e52ea81436ab15588c52fe98cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:05Z,use_quota=True,user_id='e05855e95b874257a8c813020c9643b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Creating volume a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:08 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1073741824 Sep 28 17:15:08 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-29870d41-6eda-45f5-9487-a71e1d4660b0" returned: 0 in 0.312s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "cinder-quobyte-29870d41-6eda-45f5-9487-a71e1d4660b0" released by "delete_volume" :: held 0.983s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Created reservations ['e262d743-d0ba-4273-a8cc-e61dfc688f02', '6b6382d2-2f89-4476-bd22-fd28c2c96c26', '288eedb7-1b58-4ba8-be4d-c36369a491ac', '7ac66780-e4ab-4115-8756-24bae7e8f41f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:08 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b" returned: 0 in 0.466s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:08 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b Sep 28 17:15:08 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1073741824" returned: 0 in 0.496s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:08 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 Sep 28 17:15:08 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:08 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-34124316-b712-4a6c-96aa-a6bf78a0173b" returned: 0 in 0.306s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-34124316-b712-4a6c-96aa-a6bf78a0173b" released by "delete_volume" :: held 0.845s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:08 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.345s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:08 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Deleted volume successfully. Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3af086ce-4254-4454-ab1e-1d39bf5acf75 tempest-VolumesServicesTestJSON-919956262 None] Lock "cinder-29870d41-6eda-45f5-9487-a71e1d4660b0-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Created reservations ['13927f85-cda3-4db1-b02b-430a4a4c3a7f', '96de7508-4ce1-4181-b05d-b57905aff516', '8ab52d1b-3bad-4ffa-81a3-5539be286fea', 'b9455e43-6999-44dc-9a3c-2eb4f4ac3517'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:09 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54" returned: 0 in 0.347s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Attempting download of f97d9655-73e3-49b5-a685-a1b5a7129cec ((None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}])) to volume a669bc9f-d386-435b-9a5d-38d635c2fc54. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4803369-7fc6-40b2-9836-4951ed1993a2]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92 Sep 28 17:15:09 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:09 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.357s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Deleted volume successfully. Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cef215e5-bd95-4163-9cb4-c30932c564ff tempest-VolumesActionsTest-261576784 None] Lock "cinder-34124316-b712-4a6c-96aa-a6bf78a0173b-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:09 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92" returned: 0 in 0.428s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:09 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92 Sep 28 17:15:09 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (017129b4-421d-4ff9-8e80-cff798c76442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb32207-0a82-4c79-9531-2f78b9a2999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Acquiring lock "cinder-442143bb-d67b-4fad-947a-0abed4e15783-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb32207-0a82-4c79-9531-2f78b9a2999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025147839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf198b-ae80-40d3-9b81-ce0f41bc0732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:10Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4c0d8c-c58e-4988-877a-83470eace3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4c0d8c-c58e-4988-877a-83470eace3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad97e6-d502-44ec-9b4d-8560863df521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ad97e6-d502-44ec-9b4d-8560863df521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cf198b-ae80-40d3-9b81-ce0f41bc0732', 'volume_name': 'volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96881ce3-e01a-4a30-91e2-0521f85e0cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96881ce3-e01a-4a30-91e2-0521f85e0cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8cf2ba-a604-40b6-80ad-a8d8f2011c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Volume 66cf198b-ae80-40d3-9b81-ce0f41bc0732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732', 'volume_size': 1} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025147839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cf198b-ae80-40d3-9b81-ce0f41bc0732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:10Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Creating volume 66cf198b-ae80-40d3-9b81-ce0f41bc0732 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:10 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:10 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "cinder-442143bb-d67b-4fad-947a-0abed4e15783-delete_volume" acquired by "delete_volume" :: waited 0.159s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92" returned: 1 in 0.457s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f97d9655-73e3-49b5-a685-a1b5a7129cec_tby9_w92' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:10 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 1073741824 Sep 28 17:15:10 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[30246f5f-84e0-4cd5-a124-dff92422ceb2]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Acquiring lock "cinder-quobyte-442143bb-d67b-4fad-947a-0abed4e15783" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "cinder-quobyte-442143bb-d67b-4fad-947a-0abed4e15783" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616b5a6-61b4-4a4f-bb00-e138dc336f48]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:10 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 Sep 28 17:15:10 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 0 in 0.465s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:10 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD Sep 28 17:15:10 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:10 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 1073741824" returned: 0 in 0.704s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:11 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 Sep 28 17:15:11 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783" returned: 0 in 0.711s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:11 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783 Sep 28 17:15:11 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD" returned: 1 in 0.517s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] f97d9655-73e3-49b5-a685-a1b5a7129cec was raw, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:11 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 Sep 28 17:15:11 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732" returned: 0 in 0.373s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8cf2ba-a604-40b6-80ad-a8d8f2011c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcea7ff4-6203-46b3-8438-2e6244103a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Volume volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 (66cf198b-ae80-40d3-9b81-ce0f41bc0732): created successfully Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcea7ff4-6203-46b3-8438-2e6244103a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (017129b4-421d-4ff9-8e80-cff798c76442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:11 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-442143bb-d67b-4fad-947a-0abed4e15783" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0a421b9b-e14e-4c51-9965-a3de958462be tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "cinder-quobyte-442143bb-d67b-4fad-947a-0abed4e15783" released by "delete_volume" :: held 1.165s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Created reservations ['0f6cc367-cccb-4195-8b10-2ea92cd19801', 'a5235de8-8e63-4d80-aaf8-f4cac31c76d8', '84e1f7ff-2d6e-413b-a74a-da4e50eef9c5', 'db914487-4bbd-4121-b6f6-85a6e3460803'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:11 devstack sudo[99506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:11 devstack sudo[99506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:11 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54" returned: 0 in 0.730s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f97d9655-73e3-49b5-a685-a1b5a7129cec_ju9wl2x_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:15:11 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:15:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:12 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1G Sep 28 17:15:12 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:12 devstack sudo[99506]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Deleted volume successfully. Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-963a069f-3aec-437f-b639-618d27dbb9cf tempest-VolumesImageMetadata-1851800345 None] Lock "cinder-442143bb-d67b-4fad-947a-0abed4e15783-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:12 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 1G" returned: 0 in 0.463s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Downloaded image f97d9655-73e3-49b5-a685-a1b5a7129cec ((None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}])) to volume a669bc9f-d386-435b-9a5d-38d635c2fc54 successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Temporary image f97d9655-73e3-49b5-a685-a1b5a7129cec for user e05855e95b874257a8c813020c9643b7 is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Marking volume a669bc9f-d386-435b-9a5d-38d635c2fc54 as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Copying metadata from image f97d9655-73e3-49b5-a685-a1b5a7129cec to a669bc9f-d386-435b-9a5d-38d635c2fc54. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Creating volume glance metadata for volume a669bc9f-d386-435b-9a5d-38d635c2fc54 backed by image f97d9655-73e3-49b5-a685-a1b5a7129cec with: {'image_id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '680f0af12856359cbb9871d0c8483684', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-66cf198b-ae80-40d3-9b81-ce0f41bc0732-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "cinder-66cf198b-ae80-40d3-9b81-ce0f41bc0732-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35af3d99-370d-4585-85d9-70044223a584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a669bc9f-d386-435b-9a5d-38d635c2fc54', 'volume_size': 1, 'image_id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f97d9655-73e3-49b5-a685-a1b5a7129cec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '680f0af12856359cbb9871d0c8483684', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3543e52ea81436ab15588c52fe98cc8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d37313f1752d62d7e935005ebac454c5fd27f182951c4b10ff26f271cb478a5d89069e00b08d8c4a645b09c7af71884060a0bbde0d466cf6b8089e981d4e2d9', 'id': 'f97d9655-73e3-49b5-a685-a1b5a7129cec', 'created_at': datetime.datetime(2026, 9, 28, 15, 15, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 15, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f97d9655-73e3-49b5-a685-a1b5a7129cec/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798d3e94-bf4e-4ef7-87d9-a701bab2810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Acquiring lock "cinder-quobyte-66cf198b-ae80-40d3-9b81-ce0f41bc0732" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:12 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Volume volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 (a669bc9f-d386-435b-9a5d-38d635c2fc54): created successfully Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798d3e94-bf4e-4ef7-87d9-a701bab2810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Flow 'volume_create_manager' (b84cab0b-8e21-462b-978f-d16e1dae530e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-66cf198b-ae80-40d3-9b81-ce0f41bc0732" acquired by "delete_volume" :: waited 0.068s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-369dbd53-538c-4b20-8f8d-4939df3121bd tempest-VolumeImageDependencyTests-1420856427 None] Created volume successfully. Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc44b1f-75f1-4be8-b63f-d52187a96ad9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack sudo[99515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 Sep 28 17:15:13 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732" returned: 0 in 0.510s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:13 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732 Sep 28 17:15:13 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:13 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-66cf198b-ae80-40d3-9b81-ce0f41bc0732" returned: 0 in 0.428s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "cinder-quobyte-66cf198b-ae80-40d3-9b81-ce0f41bc0732" released by "delete_volume" :: held 1.045s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Acquiring lock "cinder-a669bc9f-d386-435b-9a5d-38d635c2fc54-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Created reservations ['35acdcc4-c223-4d2d-a7f0-5487909aecb5', '41ea53d6-a33a-4c93-ac43-d26ced26a4b8', 'ca115e4b-b9ba-46f1-a6bb-29c126969f71', '930cf4e9-83a0-46fa-a052-04566473097b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "cinder-a669bc9f-d386-435b-9a5d-38d635c2fc54-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Acquiring lock "cinder-quobyte-a669bc9f-d386-435b-9a5d-38d635c2fc54" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "cinder-quobyte-a669bc9f-d386-435b-9a5d-38d635c2fc54" acquired by "delete_volume" :: waited 0.067s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:14 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:14 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d90352-1319-45c1-ab7b-7bec73a57dc8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 Sep 28 17:15:14 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:14 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.456s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:14 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Deleted volume successfully. Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e0eb2ca4-837d-4659-a50c-88be3061bd6c tempest-VolumesActionsTest-261576784 None] Lock "cinder-66cf198b-ae80-40d3-9b81-ce0f41bc0732-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:14 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54" returned: 0 in 0.600s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:14 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54 Sep 28 17:15:14 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:15 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a669bc9f-d386-435b-9a5d-38d635c2fc54" returned: 0 in 0.428s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "cinder-quobyte-a669bc9f-d386-435b-9a5d-38d635c2fc54" released by "delete_volume" :: held 1.108s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Created reservations ['69b20f7b-9f2b-42b2-9040-f9c6bc070a13', '59de199d-271f-4769-8580-f2148b6f4d3d', '7c2dd491-8b56-470b-a0b4-0d0a636a54ad', '96ee71cb-1e5d-4664-99de-062c767325f1'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:15 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:15 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:16 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Deleted volume successfully. Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (ed955e52-5bdd-48d3-a64b-78fa1ef71ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6881b557-e4a6-46f9-a9ec-1121020802b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6881b557-e4a6-46f9-a9ec-1121020802b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175364742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624d5fce-d82a-4f1e-8a94-450855360b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:16Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f4454e-80a6-4f1e-b364-f8b8019a9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f4454e-80a6-4f1e-b364-f8b8019a9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947c7d16-296b-4ce9-8fe4-ac3745ad6a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947c7d16-296b-4ce9-8fe4-ac3745ad6a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '624d5fce-d82a-4f1e-8a94-450855360b0f', 'volume_name': 'volume-624d5fce-d82a-4f1e-8a94-450855360b0f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb67573-809e-4c2b-a695-7c43609e7252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb67573-809e-4c2b-a695-7c43609e7252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf9d89-b45c-4f6a-8daa-4ece4303edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Volume 624d5fce-d82a-4f1e-8a94-450855360b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-624d5fce-d82a-4f1e-8a94-450855360b0f', 'volume_size': 1} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-175364742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=624d5fce-d82a-4f1e-8a94-450855360b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='212b5afcd0bb4359add33cdb03ec3dfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:16Z,use_quota=True,user_id='80c8544c0a9f48db8d1312661d4a63fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Creating volume 624d5fce-d82a-4f1e-8a94-450855360b0f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:16 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ec9278c6-e653-4792-a23a-a3010fc94ae6 tempest-VolumeImageDependencyTests-1420856427 None] Lock "cinder-a669bc9f-d386-435b-9a5d-38d635c2fc54-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:16 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f 1073741824 Sep 28 17:15:16 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:16 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f 1073741824" returned: 0 in 0.754s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:17 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f Sep 28 17:15:17 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:17 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f" returned: 0 in 0.319s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcf9d89-b45c-4f6a-8daa-4ece4303edd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-624d5fce-d82a-4f1e-8a94-450855360b0f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67ed39e-3b89-4360-99a6-941cec6e0223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Volume volume-624d5fce-d82a-4f1e-8a94-450855360b0f (624d5fce-d82a-4f1e-8a94-450855360b0f): created successfully Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67ed39e-3b89-4360-99a6-941cec6e0223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Flow 'volume_create_manager' (ed955e52-5bdd-48d3-a64b-78fa1ef71ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-15d39217-28c3-4776-9baa-8f5f7f126d8e tempest-VolumesActionsTest-970549374 None] Created volume successfully. Sep 28 17:15:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-624d5fce-d82a-4f1e-8a94-450855360b0f-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "cinder-624d5fce-d82a-4f1e-8a94-450855360b0f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Acquiring lock "cinder-quobyte-624d5fce-d82a-4f1e-8a94-450855360b0f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "cinder-quobyte-624d5fce-d82a-4f1e-8a94-450855360b0f" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dcadfe-0e74-47e9-b434-9facda83749e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:19 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f Sep 28 17:15:19 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:19 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f" returned: 0 in 0.589s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:19 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f Sep 28 17:15:19 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-624d5fce-d82a-4f1e-8a94-450855360b0f" returned: 0 in 0.520s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "cinder-quobyte-624d5fce-d82a-4f1e-8a94-450855360b0f" released by "delete_volume" :: held 1.191s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Created reservations ['a96238e4-3ed1-4efe-a46a-829b80fc856b', 'c18ee9c0-00aa-4094-b466-947b2412695d', 'f3048487-aa6c-4138-8ba1-5bf2ce5dad48', 'a9cfa9b9-ec16-4f4b-b791-381f6304fb0d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Flow 'volume_create_manager' (a4a86493-5fbb-40b1-94ca-5aa21de96051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db56b283-23e9-4439-92c3-3d6b4b805db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db56b283-23e9-4439-92c3-3d6b4b805db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1399924219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7722edd-1ace-4694-85c9-eae4aaea45c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6675a594db514bfe820ca2fd9ae03eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='18205448cd66465588e4e5924c63fd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d964760-dd5b-4e0a-a8f5-c783585cf249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d964760-dd5b-4e0a-a8f5-c783585cf249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcd9b26-d184-49e7-acfd-2e031b293e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdcd9b26-d184-49e7-acfd-2e031b293e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7722edd-1ace-4694-85c9-eae4aaea45c3', 'volume_name': 'volume-e7722edd-1ace-4694-85c9-eae4aaea45c3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aba5ace-4e38-4da6-91f3-cff543ca0ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aba5ace-4e38-4da6-91f3-cff543ca0ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f42a3d-a230-408b-ba98-7402dac85118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Volume e7722edd-1ace-4694-85c9-eae4aaea45c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7722edd-1ace-4694-85c9-eae4aaea45c3', 'volume_size': 1} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1399924219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7722edd-1ace-4694-85c9-eae4aaea45c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6675a594db514bfe820ca2fd9ae03eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:20Z,use_quota=True,user_id='18205448cd66465588e4e5924c63fd7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Creating volume e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:20 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 1073741824 Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:20 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:20 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:20 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.372s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Deleted volume successfully. Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e9f49a6-ebb0-4b2a-b818-571128b31aca tempest-VolumesActionsTest-970549374 None] Lock "cinder-624d5fce-d82a-4f1e-8a94-450855360b0f-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:21 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 1073741824" returned: 0 in 0.810s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:21 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 Sep 28 17:15:21 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:21 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f42a3d-a230-408b-ba98-7402dac85118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7722edd-1ace-4694-85c9-eae4aaea45c3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627446bc-8ed9-430c-bad6-937093ad8f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:21 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Volume volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 (e7722edd-1ace-4694-85c9-eae4aaea45c3): created successfully Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (627446bc-8ed9-430c-bad6-937093ad8f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:21 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Flow 'volume_create_manager' (a4a86493-5fbb-40b1-94ca-5aa21de96051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1dab8973-50cd-4d82-b9b7-f8eaff877b06 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Created volume successfully. Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Creating offline snapshot 47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d of volume e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[374cf4dc-8ed4-476d-9ae6-55a4f2dfefea]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 Sep 28 17:15:23 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Flow 'volume_create_manager' (1a4005a5-3a25-40f3-a8d4-cf464a8fa946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007bb2eb-4f80-4d51-bec9-5f3fff3b83b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (007bb2eb-4f80-4d51-bec9-5f3fff3b83b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484349961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c68676e-9c22-4eee-ab92-16fa017eb667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27054f6188e04b8d9efd9ff3fe88e547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:23Z,use_quota=True,user_id='c9a7115850384dbd87a60239c62f1713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a26f2-d565-447e-868b-99e4ed5aa1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941a26f2-d565-447e-868b-99e4ed5aa1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b537d77-2a53-4d66-a5f3-87db05b0d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b537d77-2a53-4d66-a5f3-87db05b0d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c68676e-9c22-4eee-ab92-16fa017eb667', 'volume_name': 'volume-7c68676e-9c22-4eee-ab92-16fa017eb667', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362c7503-164d-4272-b7d5-c17b5367df96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362c7503-164d-4272-b7d5-c17b5367df96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d046fa8-b030-4470-9049-d7a956a2efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Volume 7c68676e-9c22-4eee-ab92-16fa017eb667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c68676e-9c22-4eee-ab92-16fa017eb667', 'volume_size': 1} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:23 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3" returned: 0 in 0.566s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:23 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d 1G Sep 28 17:15:23 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d 1G" returned: 0 in 0.633s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d Sep 28 17:15:24 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Flow 'volume_create_manager' (e4f28233-690f-4bb9-a388-c5f30134ee27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34bfa69-1ec7-44ac-9997-e84a0018cfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" returned: 0 in 0.494s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:24 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d is being set with open permissions: ugo+rw Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:24 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b34bfa69-1ec7-44ac-9997-e84a0018cfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1597967798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40282260-e4e8-4aca-bac8-fce198d8ae74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276a9e8183c54af28ba706bf78e1b942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:25Z,use_quota=True,user_id='8f8e1001fafe430ba4733922ac919cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3a6a0a-84f7-4545-83a2-67405af3080d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3a6a0a-84f7-4545-83a2-67405af3080d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06261325-4735-48aa-9a35-9ed9ac895163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06261325-4735-48aa-9a35-9ed9ac895163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40282260-e4e8-4aca-bac8-fce198d8ae74', 'volume_name': 'volume-40282260-e4e8-4aca-bac8-fce198d8ae74', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8ae1bb-7ca8-4c6d-b25e-e3babd8c770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8ae1bb-7ca8-4c6d-b25e-e3babd8c770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcc202d-bf97-411e-94a6-f479a0436089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:24 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Volume 40282260-e4e8-4aca-bac8-fce198d8ae74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40282260-e4e8-4aca-bac8-fce198d8ae74', 'volume_size': 1} Sep 28 17:15:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:25 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" returned: 0 in 0.274s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info Sep 28 17:15:25 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info is being set with open permissions: ugo+rw Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info Sep 28 17:15:25 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.info" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-484349961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c68676e-9c22-4eee-ab92-16fa017eb667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27054f6188e04b8d9efd9ff3fe88e547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:23Z,use_quota=True,user_id='c9a7115850384dbd87a60239c62f1713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Creating volume 7c68676e-9c22-4eee-ab92-16fa017eb667 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:25 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:25 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 1073741824 Sep 28 17:15:25 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f0d29978-e277-4eb8-830a-e727cbd51265 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Create snapshot completed successfully Sep 28 17:15:26 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 1073741824" returned: 0 in 0.485s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 Sep 28 17:15:26 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1597967798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40282260-e4e8-4aca-bac8-fce198d8ae74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276a9e8183c54af28ba706bf78e1b942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:25Z,use_quota=True,user_id='8f8e1001fafe430ba4733922ac919cee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Creating volume 40282260-e4e8-4aca-bac8-fce198d8ae74 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:26 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:26 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 1073741824 Sep 28 17:15:26 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d046fa8-b030-4470-9049-d7a956a2efb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c68676e-9c22-4eee-ab92-16fa017eb667', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc50223-d539-4e90-a891-431d983047e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Volume volume-7c68676e-9c22-4eee-ab92-16fa017eb667 (7c68676e-9c22-4eee-ab92-16fa017eb667): created successfully Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc50223-d539-4e90-a891-431d983047e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Flow 'volume_create_manager' (1a4005a5-3a25-40f3-a8d4-cf464a8fa946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-18a333d8-a057-4ca7-904b-cdf7bf352cc2 tempest-ProjectReaderTests-1753414178 None] Created volume successfully. Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "cinder-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "cinder-quobyte-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Deleting offline snapshot 47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d of volume e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] snapshot_file for this snap is: volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0825e2e-770a-4d55-8da6-0c88fb35010d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[99644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d Sep 28 17:15:27 devstack sudo[99644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 1073741824" returned: 0 in 0.641s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 Sep 28 17:15:27 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack sudo[99644]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" returned: 0 in 0.498s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7722edd-1ace-4694-85c9-eae4aaea45c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ac251-6421-483f-a777-ed1dffa2dd98]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:27 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74" returned: 0 in 0.368s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fcc202d-bf97-411e-94a6-f479a0436089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40282260-e4e8-4aca-bac8-fce198d8ae74', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3575a64-5b8d-40ae-a7ad-c4566e3b1df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:27 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 Sep 28 17:15:27 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Volume volume-40282260-e4e8-4aca-bac8-fce198d8ae74 (40282260-e4e8-4aca-bac8-fce198d8ae74): created successfully Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3575a64-5b8d-40ae-a7ad-c4566e3b1df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Flow 'volume_create_manager' (e4f28233-690f-4bb9-a388-c5f30134ee27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cf60b008-a542-4e4d-9e29-e9db429a0254 tempest-VolumesMetadataTest-163600860 None] Created volume successfully. Sep 28 17:15:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "cinder-7c68676e-9c22-4eee-ab92-16fa017eb667-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-7c68676e-9c22-4eee-ab92-16fa017eb667-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "cinder-quobyte-7c68676e-9c22-4eee-ab92-16fa017eb667" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-quobyte-7c68676e-9c22-4eee-ab92-16fa017eb667" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9efde0-2848-4e04-a0fa-a2ef810ec8f5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3" returned: 0 in 0.664s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d Sep 28 17:15:28 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 Sep 28 17:15:28 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" returned: 0 in 0.490s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d Sep 28 17:15:28 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:28 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667" returned: 0 in 0.588s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:28 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667 Sep 28 17:15:28 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3.47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d" released by "_delete_snapshot" :: held 2.241s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" released by "delete_snapshot" :: held 2.277s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c68676e-9c22-4eee-ab92-16fa017eb667" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-quobyte-7c68676e-9c22-4eee-ab92-16fa017eb667" released by "delete_volume" :: held 1.113s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Acquiring lock "cinder-40282260-e4e8-4aca-bac8-fce198d8ae74-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Created reservations ['f96f2c45-d59d-467d-a3ce-552b5267172d', '14118f98-a48c-4273-943f-a53ccb07aadc', '37d8a8b7-1a10-401b-99b3-582d414612dd', '6d061c71-10fb-4a91-9d1d-df38a0f63258'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "cinder-40282260-e4e8-4aca-bac8-fce198d8ae74-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Created reservations ['ad7a9aa1-54a1-48c4-97a7-b925a344f322', '3d25be32-e066-496d-8fe5-bd9f6eb83041', 'c3cb9475-379b-4ce2-9452-6502f269d619', '2276b07b-6e06-4a67-a331-40058e583fa3'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Acquiring lock "cinder-quobyte-40282260-e4e8-4aca-bac8-fce198d8ae74" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "cinder-quobyte-40282260-e4e8-4aca-bac8-fce198d8ae74" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Delete snapshot completed successfully. Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-feeb8072-9988-420c-9206-74b16c8d4421 tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-47ef9c1e-f1eb-4eda-a6a4-e2ea4699760d-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[af348f4b-9064-4f2e-bfcf-fc2e79ffc693]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:29 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:29 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 Sep 28 17:15:29 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:29 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Deleted volume successfully. Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=163,cinder:UPDATE=218,cinder:DELETE=16,cinder:INSERT=69 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-85d3d067-c415-4d42-9fb4-4b620b2b3603 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-7c68676e-9c22-4eee-ab92-16fa017eb667-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:29 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74" returned: 0 in 0.469s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74 Sep 28 17:15:30 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "cinder-e7722edd-1ace-4694-85c9-eae4aaea45c3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-e7722edd-1ace-4694-85c9-eae4aaea45c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:30 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-40282260-e4e8-4aca-bac8-fce198d8ae74" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "cinder-quobyte-40282260-e4e8-4aca-bac8-fce198d8ae74" released by "delete_volume" :: held 0.957s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0089b37-b543-4350-9c63-95a4dea786d3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Created reservations ['e4edcc24-04a5-4544-a64e-dfb280f7987e', '24866076-b65a-4e1a-885c-c10d57201169', '94984a43-48cf-4a65-9819-6f0e232db0b8', '59c1c256-81bd-489d-a11f-5c84b3ff7969'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:30 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 Sep 28 17:15:30 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:30 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:30 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Deleted volume successfully. Sep 28 17:15:31 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3" returned: 0 in 0.636s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3 Sep 28 17:15:31 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-598050e5-2b55-4366-8ccb-ad033d36656c tempest-VolumesMetadataTest-163600860 None] Lock "cinder-40282260-e4e8-4aca-bac8-fce198d8ae74-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Flow 'volume_create_manager' (a2581d54-3ea6-4799-b553-1b0a5963ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d1ce53-98cd-4d90-92f4-bb9ae7c3bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d1ce53-98cd-4d90-92f4-bb9ae7c3bcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417059749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09109b6d-13fb-443f-bd51-ec425757c7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27054f6188e04b8d9efd9ff3fe88e547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:31Z,use_quota=True,user_id='c9a7115850384dbd87a60239c62f1713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c269d2-946c-493f-b090-7fe1068ad192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c269d2-946c-493f-b090-7fe1068ad192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f35c47-1b6b-4a5d-855c-500599a93b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f35c47-1b6b-4a5d-855c-500599a93b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09109b6d-13fb-443f-bd51-ec425757c7f8', 'volume_name': 'volume-09109b6d-13fb-443f-bd51-ec425757c7f8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d3fe1-b0dc-448b-9c58-78c653161130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644d3fe1-b0dc-448b-9c58-78c653161130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690845b6-ded0-49fc-a33c-4262171d5ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Volume 09109b6d-13fb-443f-bd51-ec425757c7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09109b6d-13fb-443f-bd51-ec425757c7f8', 'volume_size': 1} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417059749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09109b6d-13fb-443f-bd51-ec425757c7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27054f6188e04b8d9efd9ff3fe88e547',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:31Z,use_quota=True,user_id='c9a7115850384dbd87a60239c62f1713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Creating volume 09109b6d-13fb-443f-bd51-ec425757c7f8 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:31 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 1073741824 Sep 28 17:15:31 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e7722edd-1ace-4694-85c9-eae4aaea45c3" returned: 0 in 0.357s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-quobyte-e7722edd-1ace-4694-85c9-eae4aaea45c3" released by "delete_volume" :: held 1.128s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Created reservations ['bd419d1b-ce29-439b-842b-d1e94fe14397', '54d93727-c948-4d50-bf53-46e7eb3f6620', '25d42286-7e23-4d5d-ae39-c049d37923e7', '805efc8c-3b93-4fed-a1b1-88c5f8c121e3'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:31 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:31 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 1073741824" returned: 0 in 0.576s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:31 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.323s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:32 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 Sep 28 17:15:32 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Deleted volume successfully. Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-948df4e8-b577-43b6-bfcc-93accd2100bc tempest-VolumeSnapshotQuotasNegativeTestJSON-1956875074 None] Lock "cinder-e7722edd-1ace-4694-85c9-eae4aaea45c3-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:32 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8" returned: 0 in 0.296s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690845b6-ded0-49fc-a33c-4262171d5ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09109b6d-13fb-443f-bd51-ec425757c7f8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada011e-479f-4745-a0dd-ec5871d4d010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Volume volume-09109b6d-13fb-443f-bd51-ec425757c7f8 (09109b6d-13fb-443f-bd51-ec425757c7f8): created successfully Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada011e-479f-4745-a0dd-ec5871d4d010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Flow 'volume_create_manager' (a2581d54-3ea6-4799-b553-1b0a5963ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e3857ac7-7770-4d26-8842-2b6ed71ea423 tempest-ProjectReaderTests-1753414178 None] Created volume successfully. Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "cinder-09109b6d-13fb-443f-bd51-ec425757c7f8-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-09109b6d-13fb-443f-bd51-ec425757c7f8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "cinder-quobyte-09109b6d-13fb-443f-bd51-ec425757c7f8" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-quobyte-09109b6d-13fb-443f-bd51-ec425757c7f8" acquired by "delete_volume" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[907c163a-7a08-48d6-9535-e51f1c922b31]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:33 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 Sep 28 17:15:33 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:34 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8" returned: 0 in 0.627s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:34 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8 Sep 28 17:15:34 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:34 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09109b6d-13fb-443f-bd51-ec425757c7f8" returned: 0 in 0.378s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-quobyte-09109b6d-13fb-443f-bd51-ec425757c7f8" released by "delete_volume" :: held 1.088s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Created reservations ['b3c502c6-c7e7-46b9-b352-b8702da7eeab', '30235416-e91d-4f85-b71a-8608980a65ff', '91b5625e-a174-4f7f-aa75-41a14daf8025', 'e02e1323-3104-4ab2-9b5e-647b815f5d9c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:34 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:34 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:35 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:35 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Deleted volume successfully. Sep 28 17:15:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea141156-e410-4e16-9ccc-f7b26517c3d7 tempest-ProjectReaderTests-1753414178 None] Lock "cinder-09109b6d-13fb-443f-bd51-ec425757c7f8-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:41 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=171,cinder:INSERT=61,cinder:UPDATE=222,cinder:DELETE=22 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:15:41 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Flow 'volume_create_manager' (f5c0097c-5407-4d67-9b7d-4ec762d29942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baa4a3b-998d-4676-a03d-4d5359ad829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2baa4a3b-998d-4676-a03d-4d5359ad829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-174636096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f8db1-add2-4f78-a7af-025ae157fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e2c65f902449859847b34267224bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:42Z,use_quota=True,user_id='bc92ee03b14d4b7a9239842394c5e779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a159b-35b2-4968-bce7-439f417d4163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10a159b-35b2-4968-bce7-439f417d4163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050abe9-6729-4d15-8a9a-45f3664ad257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c050abe9-6729-4d15-8a9a-45f3664ad257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298f8db1-add2-4f78-a7af-025ae157fbb9', 'volume_name': 'volume-298f8db1-add2-4f78-a7af-025ae157fbb9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065d9123-d399-430b-9105-d8d4bc2723c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065d9123-d399-430b-9105-d8d4bc2723c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3480e1-2784-4df5-841f-7271f3068e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:42 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Volume 298f8db1-add2-4f78-a7af-025ae157fbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298f8db1-add2-4f78-a7af-025ae157fbb9', 'volume_size': 1} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-174636096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298f8db1-add2-4f78-a7af-025ae157fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e2c65f902449859847b34267224bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:42Z,use_quota=True,user_id='bc92ee03b14d4b7a9239842394c5e779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Creating volume 298f8db1-add2-4f78-a7af-025ae157fbb9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:42 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:42 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 1073741824 Sep 28 17:15:42 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:42 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 1073741824" returned: 0 in 0.599s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:42 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 Sep 28 17:15:42 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:43 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9" returned: 0 in 0.408s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3480e1-2784-4df5-841f-7271f3068e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298f8db1-add2-4f78-a7af-025ae157fbb9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad4e321-c779-4894-b02d-836b4e6e0e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Volume volume-298f8db1-add2-4f78-a7af-025ae157fbb9 (298f8db1-add2-4f78-a7af-025ae157fbb9): created successfully Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ad4e321-c779-4894-b02d-836b4e6e0e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Flow 'volume_create_manager' (f5c0097c-5407-4d67-9b7d-4ec762d29942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d5ac118b-1a5d-4079-9984-6782d818f2de tempest-VolumesTransfersV357Test-1818967605 None] Created volume successfully. Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (0aa83888-2b92-4f3d-9cc4-7d98100a8f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd21fd4-d708-44fa-bdf7-df4ff9466d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd21fd4-d708-44fa-bdf7-df4ff9466d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-848203012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71aa7efd-f19b-4c77-bf89-a0fd66c30bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:44Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b7bfa1-fa39-488c-8ba5-80c08e7c22d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b7bfa1-fa39-488c-8ba5-80c08e7c22d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0fd90-7bdc-4272-ad92-3eeac933e62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda0fd90-7bdc-4272-ad92-3eeac933e62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71aa7efd-f19b-4c77-bf89-a0fd66c30bf1', 'volume_name': 'volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac54f42f-d0d5-4f12-999a-0f89645c74cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac54f42f-d0d5-4f12-999a-0f89645c74cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0d42b-eb13-465d-b647-d1307c11bd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:44 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Volume 71aa7efd-f19b-4c77-bf89-a0fd66c30bf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1', 'volume_size': 1} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-848203012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71aa7efd-f19b-4c77-bf89-a0fd66c30bf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:44Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Creating volume 71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:44 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 1073741824 Sep 28 17:15:44 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:44 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 1073741824" returned: 0 in 0.717s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:44 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 Sep 28 17:15:44 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:44 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.452s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:15:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:15:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4910497d-683e-45f8-b272-f0010ecd587e tempest-VolumesTransfersV357Test-2139196596 None] Transfer volume completed successfully. Sep 28 17:15:45 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" returned: 0 in 0.474s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0d42b-eb13-465d-b647-d1307c11bd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47cc166-1893-4a0b-b765-03a3ab6948a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:45 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Volume volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 (71aa7efd-f19b-4c77-bf89-a0fd66c30bf1): created successfully Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f47cc166-1893-4a0b-b765-03a3ab6948a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (0aa83888-2b92-4f3d-9cc4-7d98100a8f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-bbdc787a-5cf1-49bd-84e8-52e5712b75c2 tempest-VolumesListAdminTestJSON-1154155212 None] Created volume successfully. Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "cinder-298f8db1-add2-4f78-a7af-025ae157fbb9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-298f8db1-add2-4f78-a7af-025ae157fbb9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "cinder-quobyte-298f8db1-add2-4f78-a7af-025ae157fbb9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-quobyte-298f8db1-add2-4f78-a7af-025ae157fbb9" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd375b2-eea3-4914-b152-3d139321a236]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:46 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 Sep 28 17:15:46 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (a971e353-17bd-477d-964e-5ab3762e3284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addf286a-8054-473c-894e-60bf7686d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (addf286a-8054-473c-894e-60bf7686d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1195216199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e8ef4b-144b-4ea7-8c41-07c3337e1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e8ef4b-144b-4ea7-8c41-07c3337e1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3c9be8-6d16-4009-9c95-3ff5523fe71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3c9be8-6d16-4009-9c95-3ff5523fe71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915', 'volume_name': 'volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e0b88-fdf0-42fd-b8b3-d95fcfe4d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04e0b88-fdf0-42fd-b8b3-d95fcfe4d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c06096-6abc-455a-81e9-73a7284bd874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Volume 8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915', 'volume_size': 1} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1195216199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:47Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Creating volume 8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:47 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:47 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 1073741824 Sep 28 17:15:47 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:47 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9" returned: 0 in 0.619s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:47 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9 Sep 28 17:15:47 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:47 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-298f8db1-add2-4f78-a7af-025ae157fbb9" returned: 0 in 0.355s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-quobyte-298f8db1-add2-4f78-a7af-025ae157fbb9" released by "delete_volume" :: held 1.056s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Created reservations ['ff853591-5d0c-4dbd-839c-b198292b07d3', '20d0aa41-cebd-4992-aed0-c87fc14f8d28', '45b0fd28-bd06-4f7c-9c9a-0774ae430123', 'd53294a6-c9ad-4196-bdcd-37211cf74b02'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:47 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 1073741824" returned: 0 in 0.726s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:48 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:48 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:48 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 Sep 28 17:15:48 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:48 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.448s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Deleted volume successfully. Sep 28 17:15:48 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70e8959f-f053-4d0e-a923-47b50570f8d1 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-298f8db1-add2-4f78-a7af-025ae157fbb9-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97c06096-6abc-455a-81e9-73a7284bd874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b9a2a-86d8-4a8d-810a-1fb8a42c05d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:48 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Volume volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 (8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915): created successfully Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6b9a2a-86d8-4a8d-810a-1fb8a42c05d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (a971e353-17bd-477d-964e-5ab3762e3284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-48474afd-98c2-4136-887c-26acbe6e02da tempest-VolumesListAdminTestJSON-1154155212 None] Created volume successfully. Sep 28 17:15:49 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Flow 'volume_create_manager' (606ddd17-fb8c-47d6-97ac-856ba385062b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a4e5c-f69a-4b5c-b36c-4ffe8a08a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d60a4e5c-f69a-4b5c-b36c-4ffe8a08a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-612384982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d1acc-130b-4b2f-8919-b92a2354bd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e2c65f902449859847b34267224bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='bc92ee03b14d4b7a9239842394c5e779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901e2e85-e30a-44af-b9b3-f3979b952101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901e2e85-e30a-44af-b9b3-f3979b952101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814fd90b-1b84-4a31-955b-9b0b5feee5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814fd90b-1b84-4a31-955b-9b0b5feee5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9d1acc-130b-4b2f-8919-b92a2354bd4e', 'volume_name': 'volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bbe5f-04eb-45b6-8134-04019e9fa694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265bbe5f-04eb-45b6-8134-04019e9fa694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e6be9e-88e3-4ec6-8fba-89fed8f7e881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Volume 9e9d1acc-130b-4b2f-8919-b92a2354bd4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e', 'volume_size': 1} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-612384982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9d1acc-130b-4b2f-8919-b92a2354bd4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e2c65f902449859847b34267224bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='bc92ee03b14d4b7a9239842394c5e779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Creating volume 9e9d1acc-130b-4b2f-8919-b92a2354bd4e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:50 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e 1073741824 Sep 28 17:15:50 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (44d5e040-3d49-4cc3-a6ce-bd2326180e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87915357-bbe7-4288-9f30-9beb47d677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87915357-bbe7-4288-9f30-9beb47d677c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095811102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fbbc69-0027-48f5-a419-2137d298c802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e49874-b71d-427f-8b02-56ec8ff124f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e49874-b71d-427f-8b02-56ec8ff124f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2417690-41f0-44c9-93dd-0212daf3915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2417690-41f0-44c9-93dd-0212daf3915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fbbc69-0027-48f5-a419-2137d298c802', 'volume_name': 'volume-73fbbc69-0027-48f5-a419-2137d298c802', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8832e2-f7af-4447-937b-a0ea4d39ee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8832e2-f7af-4447-937b-a0ea4d39ee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658d1923-825d-4846-a85e-d2e20055f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Volume 73fbbc69-0027-48f5-a419-2137d298c802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fbbc69-0027-48f5-a419-2137d298c802', 'volume_size': 1} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:50 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e 1073741824" returned: 0 in 0.629s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:50 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e Sep 28 17:15:50 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" returned: 0 in 0.300s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1095811102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fbbc69-0027-48f5-a419-2137d298c802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2a9cb548ce340ae9670c733b0a8a0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:50Z,use_quota=True,user_id='10804ad1865c4460ae09c65faab6185d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Creating volume 73fbbc69-0027-48f5-a419-2137d298c802 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:51 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e6be9e-88e3-4ec6-8fba-89fed8f7e881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 1073741824 Sep 28 17:15:51 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9662ed3-9b2a-442a-ae4c-bdf8b5fecb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:51 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Volume volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e (9e9d1acc-130b-4b2f-8919-b92a2354bd4e): created successfully Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9662ed3-9b2a-442a-ae4c-bdf8b5fecb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Flow 'volume_create_manager' (606ddd17-fb8c-47d6-97ac-856ba385062b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c989d704-d201-4706-b9f4-4bd6284d4917 tempest-VolumesTransfersV357Test-1818967605 None] Created volume successfully. Sep 28 17:15:51 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 1073741824" returned: 0 in 0.543s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:51 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 Sep 28 17:15:51 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:52 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802" returned: 0 in 0.337s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (658d1923-825d-4846-a85e-d2e20055f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fbbc69-0027-48f5-a419-2137d298c802', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72ed806-2093-4cf3-ac72-d016007e45b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:52 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Volume volume-73fbbc69-0027-48f5-a419-2137d298c802 (73fbbc69-0027-48f5-a419-2137d298c802): created successfully Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e72ed806-2093-4cf3-ac72-d016007e45b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Flow 'volume_create_manager' (44d5e040-3d49-4cc3-a6ce-bd2326180e0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a16132d9-a4b2-49b5-b209-7a1147c64eb6 tempest-VolumesListAdminTestJSON-1154155212 None] Created volume successfully. Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "cinder-9e9d1acc-130b-4b2f-8919-b92a2354bd4e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-9e9d1acc-130b-4b2f-8919-b92a2354bd4e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "cinder-quobyte-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-quobyte-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b139466-3fa2-48d4-9da5-2bed5393ea46]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:52 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e Sep 28 17:15:52 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" returned: 0 in 0.571s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e Sep 28 17:15:53 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Flow 'volume_create_manager' (63f68df1-398f-48c9-92db-1bad3185716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b6e1bf-87a6-48e5-8a3e-756afca97f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b6e1bf-87a6-48e5-8a3e-756afca97f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde0b593-d942-4053-b9b0-08bfd1b94e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b394db61d1040dda6f39e124cd8201d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:53Z,use_quota=True,user_id='b1eecd7d01834d77a989f802790032a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd592f-f016-4c75-831c-b08f64ab10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffd592f-f016-4c75-831c-b08f64ab10cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9a4d80-bf8b-4a82-9f40-be200cac1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd9a4d80-bf8b-4a82-9f40-be200cac1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde0b593-d942-4053-b9b0-08bfd1b94e43', 'volume_name': 'volume-bde0b593-d942-4053-b9b0-08bfd1b94e43', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ca22f-2a7c-4f47-b1b5-6f1501438246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027ca22f-2a7c-4f47-b1b5-6f1501438246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf96df8-0056-46af-9eb2-c4c4d2d6b46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:53 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Volume bde0b593-d942-4053-b9b0-08bfd1b94e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde0b593-d942-4053-b9b0-08bfd1b94e43', 'volume_size': 1} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde0b593-d942-4053-b9b0-08bfd1b94e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b394db61d1040dda6f39e124cd8201d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:53Z,use_quota=True,user_id='b1eecd7d01834d77a989f802790032a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Creating volume bde0b593-d942-4053-b9b0-08bfd1b94e43 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:53 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" returned: 0 in 0.499s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-quobyte-9e9d1acc-130b-4b2f-8919-b92a2354bd4e" released by "delete_volume" :: held 1.136s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:53 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 1073741824 Sep 28 17:15:53 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Created reservations ['85f8373c-520f-4f2f-8b13-d958b3d1764e', '9e197285-cfc0-488c-8310-6c764c76443e', 'e647b67b-5e92-4ecf-9077-c893cfc9956e', 'fa1d1933-b568-4958-9098-8b38926de2eb'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:53 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:53 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:54 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.299s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Deleted volume successfully. Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fac3a17-f568-4a38-bbf6-407a1e1de9e0 tempest-VolumesTransfersV357Test-1156470045 None] Lock "cinder-9e9d1acc-130b-4b2f-8919-b92a2354bd4e-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:54 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 1073741824" returned: 0 in 0.619s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:54 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 Sep 28 17:15:54 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:54 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf96df8-0056-46af-9eb2-c4c4d2d6b46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde0b593-d942-4053-b9b0-08bfd1b94e43', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c33ab-666e-4e79-a312-bf4406167f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:54 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Volume volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 (bde0b593-d942-4053-b9b0-08bfd1b94e43): created successfully Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c33ab-666e-4e79-a312-bf4406167f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Flow 'volume_create_manager' (63f68df1-398f-48c9-92db-1bad3185716e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:54 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e521fc91-89e1-417a-b41a-a9af4155f117 tempest-VolumesListAdminTestJSON-403562513 None] Created volume successfully. Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Acquiring lock "cinder-bde0b593-d942-4053-b9b0-08bfd1b94e43-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "cinder-bde0b593-d942-4053-b9b0-08bfd1b94e43-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Acquiring lock "cinder-quobyte-bde0b593-d942-4053-b9b0-08bfd1b94e43" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "cinder-quobyte-bde0b593-d942-4053-b9b0-08bfd1b94e43" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8486551-78ba-4313-9a4a-3e18da3a74d5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-73fbbc69-0027-48f5-a419-2137d298c802-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-73fbbc69-0027-48f5-a419-2137d298c802-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-quobyte-73fbbc69-0027-48f5-a419-2137d298c802" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-73fbbc69-0027-48f5-a419-2137d298c802" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:56 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 Sep 28 17:15:56 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc1757c-8b08-45ce-8162-9aa3dfb49fe0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 Sep 28 17:15:56 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43" returned: 0 in 0.604s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43 Sep 28 17:15:56 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802" returned: 0 in 0.582s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:56 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802 Sep 28 17:15:56 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:56 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bde0b593-d942-4053-b9b0-08bfd1b94e43" returned: 0 in 0.340s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "cinder-quobyte-bde0b593-d942-4053-b9b0-08bfd1b94e43" released by "delete_volume" :: held 1.018s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Created reservations ['143451c5-082d-4e5a-bfbc-13660afe5b21', '7def94b8-37a9-4574-be87-646b07519070', '103e8574-fc7f-48c2-aa27-35ce04676eb6', 'bbf601f3-8b40-4d0a-834a-084d9deb681b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:57 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:57 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-73fbbc69-0027-48f5-a419-2137d298c802" returned: 0 in 0.454s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-73fbbc69-0027-48f5-a419-2137d298c802" released by "delete_volume" :: held 1.106s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Created reservations ['2c3b3d2d-8ee0-4d8b-81b3-1b35a09706c4', '7485e068-a2d4-4469-98bc-a9ac2e797e78', '4c172e22-1b36-4ae5-9fd4-fc0780050d34', '92fa3225-a3ff-41a6-86ba-fe0064d474ad'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:57 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Deleted volume successfully. Sep 28 17:15:57 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:57 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3bba43a5-333e-4acd-bb26-f733a202a6f5 tempest-VolumesListAdminTestJSON-403562513 None] Lock "cinder-bde0b593-d942-4053-b9b0-08bfd1b94e43-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:57 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:15:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Deleted volume successfully. Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-27782ec0-cf51-4902-ae6a-608f3dc592fd tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-73fbbc69-0027-48f5-a419-2137d298c802-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Flow 'volume_create_manager' (cd586912-8c82-4c25-8dba-c17b1b9b0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde4db1b-0039-4a7a-a52f-8f8b1c87f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde4db1b-0039-4a7a-a52f-8f8b1c87f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-73574777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29736d8-f51d-4395-a168-d191a46bd2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e825adba14ce396ae5cc7df378870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:58Z,use_quota=True,user_id='39923835f00348c881eee923e26992e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28872184-3433-456d-b162-2ef79017e524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28872184-3433-456d-b162-2ef79017e524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e412835-3e6a-4e98-943c-f64efb5f9cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e412835-3e6a-4e98-943c-f64efb5f9cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29736d8-f51d-4395-a168-d191a46bd2c5', 'volume_name': 'volume-b29736d8-f51d-4395-a168-d191a46bd2c5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1a39db-b23f-47b3-af25-c8762bafdc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f1a39db-b23f-47b3-af25-c8762bafdc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a67154-f68c-4d91-a7e5-f97ec97168c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Volume b29736d8-f51d-4395-a168-d191a46bd2c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29736d8-f51d-4395-a168-d191a46bd2c5', 'volume_size': 1} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-73574777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29736d8-f51d-4395-a168-d191a46bd2c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e825adba14ce396ae5cc7df378870',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:15:58Z,use_quota=True,user_id='39923835f00348c881eee923e26992e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Creating volume b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:15:58 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 1073741824 Sep 28 17:15:58 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-quobyte-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4d3a4e-ec7e-41e6-9fdd-5628813edbca]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 Sep 28 17:15:58 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:58 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 1073741824" returned: 0 in 0.638s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:58 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 Sep 28 17:15:58 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915 Sep 28 17:15:59 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5" returned: 0 in 0.343s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a67154-f68c-4d91-a7e5-f97ec97168c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29736d8-f51d-4395-a168-d191a46bd2c5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76339eb-be3e-451c-bac2-0aa0e36747bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:15:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Volume volume-b29736d8-f51d-4395-a168-d191a46bd2c5 (b29736d8-f51d-4395-a168-d191a46bd2c5): created successfully Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f76339eb-be3e-451c-bac2-0aa0e36747bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Flow 'volume_create_manager' (cd586912-8c82-4c25-8dba-c17b1b9b0e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:15:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-16072243-e4d5-4cff-9b3b-d5d71004739d tempest-SnapshotMetadataTestJSON-109081766 None] Created volume successfully. Sep 28 17:15:59 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" returned: 0 in 0.330s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915" released by "delete_volume" :: held 0.911s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Created reservations ['31f2f37a-527c-4609-909d-7588a7014eb0', '9260e091-8119-4042-a25c-111fe0633e4c', 'efba2e19-dd1d-4fe8-9b22-7e9a2be64938', '1beae334-638e-46d5-aa94-8f23eee4f76c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:15:59 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:15:59 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "cinder-quobyte-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03eba73-540e-475b-b589-87d1acde6e7a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:15:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.414s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Deleted volume successfully. Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7d43a458-2699-40a3-bf07-728732cee772 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-8cf80dd0-b1cc-40f0-b7d9-7e1e758fe915-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:00 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 Sep 28 17:16:00 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Creating offline snapshot 27a347c4-cf81-4288-8e02-8ebb6186e256 of volume b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:00 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb007ac-42e8-4465-ab92-d4ecd5cffd8e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" returned: 0 in 0.560s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1 Sep 28 17:16:00 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 Sep 28 17:16:00 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:00 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" returned: 0 in 0.338s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-quobyte-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1" released by "delete_volume" :: held 0.988s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Created reservations ['691b2160-f9b6-40fd-96f4-e6c9060fd276', '193b19f5-de11-4956-ae6d-4f3ed0d3b9b1', '44ecad2a-531b-4d24-91c3-d8f965fd31d1', 'e0a4839f-7db9-4888-aacd-cdd684871002'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:00 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5" returned: 0 in 0.484s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:00 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 1G Sep 28 17:16:00 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:01 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Deleted volume successfully. Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c1679def-1d1a-4356-9bf8-00f5f955b653 tempest-VolumesListAdminTestJSON-1154155212 None] Lock "cinder-71aa7efd-f19b-4c77-bf89-a0fd66c30bf1-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:01 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 1G" returned: 0 in 0.627s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29736d8-f51d-4395-a168-d191a46bd2c5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29736d8-f51d-4395-a168-d191a46bd2c5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 Sep 28 17:16:01 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:01 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29736d8-f51d-4395-a168-d191a46bd2c5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:01 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 is being set with open permissions: ugo+rw Sep 28 17:16:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:01 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 Sep 28 17:16:01 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256" returned: 0 in 0.362s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info Sep 28 17:16:02 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info" returned: 0 in 0.360s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:02 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info is being set with open permissions: ugo+rw Sep 28 17:16:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:02 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info Sep 28 17:16:02 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:02 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.info" returned: 0 in 0.303s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8709fcdb-2681-4540-b1ab-75245a0e7573 tempest-SnapshotMetadataTestJSON-109081766 None] Create snapshot completed successfully Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "cinder-27a347c4-cf81-4288-8e02-8ebb6186e256-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-27a347c4-cf81-4288-8e02-8ebb6186e256-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "cinder-quobyte-27a347c4-cf81-4288-8e02-8ebb6186e256" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-27a347c4-cf81-4288-8e02-8ebb6186e256" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Deleting offline snapshot 27a347c4-cf81-4288-8e02-8ebb6186e256 of volume b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] snapshot_file for this snap is: volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d7f27-c0f6-4641-89bf-0069f5d29b02]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:05 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 Sep 28 17:16:05 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:05 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256" returned: 0 in 0.509s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29736d8-f51d-4395-a168-d191a46bd2c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5373389-cc19-40b0-bf8c-a3baf88f810b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:05 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 Sep 28 17:16:05 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:06 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5" returned: 0 in 0.558s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:06 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 Sep 28 17:16:06 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:06 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256" returned: 0 in 0.436s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:06 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256 Sep 28 17:16:06 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:07 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5.27a347c4-cf81-4288-8e02-8ebb6186e256" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-27a347c4-cf81-4288-8e02-8ebb6186e256" released by "_delete_snapshot" :: held 2.206s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" released by "delete_snapshot" :: held 2.243s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:07 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Created reservations ['44476e93-852b-413f-ad49-c1b4560a99af', 'f587ddcc-9421-41fa-afc1-ec02d8ef4716', '2fe77f06-1ad8-4438-b9e2-638154eb5dde', '3ad82fe4-81e1-4ad9-98ef-a20ccd5d7e38'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Delete snapshot completed successfully. Sep 28 17:16:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-23051956-e4dc-4bc6-a4b6-7a1747e8d766 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-27a347c4-cf81-4288-8e02-8ebb6186e256-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "cinder-b29736d8-f51d-4395-a168-d191a46bd2c5-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-b29736d8-f51d-4395-a168-d191a46bd2c5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91ff460-c150-4285-9f44-0baf349862f7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:08 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 Sep 28 17:16:08 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:09 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5" returned: 0 in 0.518s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5 Sep 28 17:16:09 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:09 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b29736d8-f51d-4395-a168-d191a46bd2c5" returned: 0 in 0.446s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-quobyte-b29736d8-f51d-4395-a168-d191a46bd2c5" released by "delete_volume" :: held 1.067s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Created reservations ['fe23abe8-cb9e-4688-a1e3-c7d15b4cbb38', 'a5e44f85-f87b-4b74-b103-4555ca459f1b', 'eda2ae90-a21d-434b-b353-0adc8afa4b69', '206a50d1-e735-474b-a6c0-2b9d0da75cb0'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:09 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:09 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:10 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.375s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Deleted volume successfully. Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d5652678-4a3c-4055-9571-c355b76b86c7 tempest-SnapshotMetadataTestJSON-109081766 None] Lock "cinder-b29736d8-f51d-4395-a168-d191a46bd2c5-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Flow 'volume_create_manager' (68ca3a9b-7d08-46bf-8a6d-34ad39aeba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c19fa5-bc6a-49cb-84b2-e31c338351a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55c19fa5-bc6a-49cb-84b2-e31c338351a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-406464224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1227418-8c3e-4d47-871a-01fb66ece43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5af2c51a0b547b5b9d4178c54f37705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:11Z,use_quota=True,user_id='a8b32379db9a4739a3a09e2ec74c5325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed906925-0303-4fb6-b70b-7c7644049e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed906925-0303-4fb6-b70b-7c7644049e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618fe70e-9ce4-47c8-92dc-e2e5effc2ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (618fe70e-9ce4-47c8-92dc-e2e5effc2ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1227418-8c3e-4d47-871a-01fb66ece43b', 'volume_name': 'volume-e1227418-8c3e-4d47-871a-01fb66ece43b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013551f7-59e9-40b8-9d0b-3bb741330aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013551f7-59e9-40b8-9d0b-3bb741330aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd6723e-1f7c-4bcf-b735-d32f9c552436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Volume e1227418-8c3e-4d47-871a-01fb66ece43b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1227418-8c3e-4d47-871a-01fb66ece43b', 'volume_size': 1} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-406464224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1227418-8c3e-4d47-871a-01fb66ece43b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5af2c51a0b547b5b9d4178c54f37705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:11Z,use_quota=True,user_id='a8b32379db9a4739a3a09e2ec74c5325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Creating volume e1227418-8c3e-4d47-871a-01fb66ece43b {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:10 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:10 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b 1073741824 Sep 28 17:16:10 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b 1073741824" returned: 0 in 0.648s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:11 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b Sep 28 17:16:11 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:11 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dd6723e-1f7c-4bcf-b735-d32f9c552436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1227418-8c3e-4d47-871a-01fb66ece43b', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2f32a9-8198-488b-91db-c0f017748cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Volume volume-e1227418-8c3e-4d47-871a-01fb66ece43b (e1227418-8c3e-4d47-871a-01fb66ece43b): created successfully Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f2f32a9-8198-488b-91db-c0f017748cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Flow 'volume_create_manager' (68ca3a9b-7d08-46bf-8a6d-34ad39aeba41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a125a416-e827-46d4-8324-d4bf98f3e26c tempest-AbsoluteLimitsTests-1775018103 None] Created volume successfully. Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Acquiring lock "cinder-e1227418-8c3e-4d47-871a-01fb66ece43b-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "cinder-e1227418-8c3e-4d47-871a-01fb66ece43b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Acquiring lock "cinder-quobyte-e1227418-8c3e-4d47-871a-01fb66ece43b" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "cinder-quobyte-e1227418-8c3e-4d47-871a-01fb66ece43b" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbc0e0f-72ad-4992-949c-e96130239e47]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:13 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b Sep 28 17:16:13 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b Sep 28 17:16:14 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:14 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1227418-8c3e-4d47-871a-01fb66ece43b" returned: 0 in 0.338s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "cinder-quobyte-e1227418-8c3e-4d47-871a-01fb66ece43b" released by "delete_volume" :: held 0.911s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Created reservations ['fb96bb02-4660-4b7d-9b3a-e23f1af32bec', '898c8462-1bab-4fb5-bcbd-28aed5dba6a2', '2d483df5-c61c-4a00-b9eb-bc89304051ca', 'abd260b6-804e-4aa5-93c9-99bf3472a051'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:14 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:14 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:15 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:15 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Deleted volume successfully. Sep 28 17:16:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e9d42012-44cc-4985-9e60-946c02af2ccc tempest-AbsoluteLimitsTests-1775018103 None] Lock "cinder-e1227418-8c3e-4d47-871a-01fb66ece43b-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Flow 'volume_create_manager' (def26778-3352-4d51-b9fc-aa189bc69f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f4deb-5235-43be-96a6-614765eb3df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b64f4deb-5235-43be-96a6-614765eb3df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227571382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874a4cc5-183b-49b2-b407-10458f02d254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd03976a4574e0c85422764441070e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:19Z,use_quota=True,user_id='0a8954139c774d56a218e952bf980079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001bcb2b-b691-49c6-b525-6e03782a5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001bcb2b-b691-49c6-b525-6e03782a5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b62fa16-2f91-4973-9f9b-115d2cbf03eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b62fa16-2f91-4973-9f9b-115d2cbf03eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '874a4cc5-183b-49b2-b407-10458f02d254', 'volume_name': 'volume-874a4cc5-183b-49b2-b407-10458f02d254', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1293022c-8f5d-4a6c-b051-4482231c83cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1293022c-8f5d-4a6c-b051-4482231c83cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23d2017-5612-4ba3-8267-7bd82ea88440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Volume 874a4cc5-183b-49b2-b407-10458f02d254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-874a4cc5-183b-49b2-b407-10458f02d254', 'volume_size': 1} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227571382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=874a4cc5-183b-49b2-b407-10458f02d254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd03976a4574e0c85422764441070e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:19Z,use_quota=True,user_id='0a8954139c774d56a218e952bf980079',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Creating volume 874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:18 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 1073741824 Sep 28 17:16:19 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Flow 'volume_create_manager' (0b034a62-7cff-4f4f-a4f1-282ae5778805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9184535e-7b9e-4c36-86b4-4e9a65665f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9184535e-7b9e-4c36-86b4-4e9a65665f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-87318284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6517ba-d9c4-4f33-b17c-7211c49176f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ddd5385af40b7a319d00a09b94b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:19Z,use_quota=True,user_id='c10295c3cbcd4e9d9ef9d58b936d5e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c20f4c-d60b-422e-9c20-e1e6dd87f014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c20f4c-d60b-422e-9c20-e1e6dd87f014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c69fbdd-ec8b-49d8-a1de-4e005817181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c69fbdd-ec8b-49d8-a1de-4e005817181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6517ba-d9c4-4f33-b17c-7211c49176f6', 'volume_name': 'volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4eea9e-7434-4798-9880-97b0f9ad29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc4eea9e-7434-4798-9880-97b0f9ad29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e822976-329a-438f-be48-0bf9112d2af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Volume cf6517ba-d9c4-4f33-b17c-7211c49176f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6', 'volume_size': 1} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 1073741824" returned: 0 in 0.614s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:16:19 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:19 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.298s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-87318284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6517ba-d9c4-4f33-b17c-7211c49176f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ddd5385af40b7a319d00a09b94b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:19Z,use_quota=True,user_id='c10295c3cbcd4e9d9ef9d58b936d5e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Creating volume cf6517ba-d9c4-4f33-b17c-7211c49176f6 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:19 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23d2017-5612-4ba3-8267-7bd82ea88440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-874a4cc5-183b-49b2-b407-10458f02d254', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5c5b56-b8cc-4c09-baca-84179f018910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:19 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 1073741824 Sep 28 17:16:19 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Volume volume-874a4cc5-183b-49b2-b407-10458f02d254 (874a4cc5-183b-49b2-b407-10458f02d254): created successfully Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5c5b56-b8cc-4c09-baca-84179f018910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Flow 'volume_create_manager' (def26778-3352-4d51-b9fc-aa189bc69f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ae52e917-5613-4421-bc99-e4bb0df856da tempest-VolumesActionsTest-1454502236 None] Created volume successfully. Sep 28 17:16:20 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 1073741824" returned: 0 in 0.595s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:20 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 Sep 28 17:16:20 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:20 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e822976-329a-438f-be48-0bf9112d2af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35099b9-51c8-4329-8ed8-184df04082e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Volume volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 (cf6517ba-d9c4-4f33-b17c-7211c49176f6): created successfully Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35099b9-51c8-4329-8ed8-184df04082e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Flow 'volume_create_manager' (0b034a62-7cff-4f4f-a4f1-282ae5778805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f3b05cbb-4186-47b9-b44a-218aae719ed6 tempest-VolumesTransfersTest-909722507 None] Created volume successfully. Sep 28 17:16:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1198a3cd-1145-455a-890d-2bd7d2ef64ec tempest-VolumesTransfersTest-1785052571 None] Transfer volume completed successfully. Sep 28 17:16:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "cinder-cf6517ba-d9c4-4f33-b17c-7211c49176f6-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-cf6517ba-d9c4-4f33-b17c-7211c49176f6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "cinder-quobyte-cf6517ba-d9c4-4f33-b17c-7211c49176f6" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-quobyte-cf6517ba-d9c4-4f33-b17c-7211c49176f6" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d5d344-c829-404a-aa48-69a5e2b437b4]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 Sep 28 17:16:24 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6" returned: 0 in 0.571s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:24 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6 Sep 28 17:16:24 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Flow 'volume_create_manager' (0b30ecb4-0936-4147-8c13-0bf996a84e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a8f870-f717-4964-98ee-7750f15c77e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a8f870-f717-4964-98ee-7750f15c77e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-597156732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dba6b-4d93-4d52-bd8b-99b4e4044451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa2671a19ea4998b27ea5eb9a3e53fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:25Z,use_quota=True,user_id='ecbbd68ac8eb4fcab8722b30198e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011e567d-b8c0-4187-bf35-8577048f2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011e567d-b8c0-4187-bf35-8577048f2013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102105b1-d136-42b5-ac69-6468a91a3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (102105b1-d136-42b5-ac69-6468a91a3d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8dba6b-4d93-4d52-bd8b-99b4e4044451', 'volume_name': 'volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bfd320-131e-4edd-ba4d-13b5919aadc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33bfd320-131e-4edd-ba4d-13b5919aadc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17fe1d8-f354-4cce-83e0-f6fbc752a148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:24 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Volume de8dba6b-4d93-4d52-bd8b-99b4e4044451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451', 'volume_size': 1} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-597156732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8dba6b-4d93-4d52-bd8b-99b4e4044451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa2671a19ea4998b27ea5eb9a3e53fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:25Z,use_quota=True,user_id='ecbbd68ac8eb4fcab8722b30198e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Creating volume de8dba6b-4d93-4d52-bd8b-99b4e4044451 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:24 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 1073741824 Sep 28 17:16:25 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:25 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-cf6517ba-d9c4-4f33-b17c-7211c49176f6" returned: 0 in 0.406s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-quobyte-cf6517ba-d9c4-4f33-b17c-7211c49176f6" released by "delete_volume" :: held 1.043s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Created reservations ['dd440540-6bed-43bf-a6e4-54a119d7fb2c', 'ebb846db-75a1-47f2-933d-94659001fd8c', 'f94439e1-a361-4b28-87f5-a1c5f7f049c1', 'f5b9577f-5370-47be-ba67-fdf70c5a864a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:25 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:25 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 1073741824" returned: 0 in 0.786s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.445s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Deleted volume successfully. Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8b13e523-0a19-4a15-bfc5-1d840f96b155 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-cf6517ba-d9c4-4f33-b17c-7211c49176f6-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:25 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 Sep 28 17:16:25 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:26 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451" returned: 0 in 0.382s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17fe1d8-f354-4cce-83e0-f6fbc752a148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dab686-d19d-41e4-a03a-eceb3c328c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Volume volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 (de8dba6b-4d93-4d52-bd8b-99b4e4044451): created successfully Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74dab686-d19d-41e4-a03a-eceb3c328c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Flow 'volume_create_manager' (0b30ecb4-0936-4147-8c13-0bf996a84e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c13c19de-827a-4582-809f-fbda25d6d415 tempest-VolumesTransfersV355Test-1706668601 None] Created volume successfully. Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Flow 'volume_create_manager' (40504011-8293-4a2e-998e-5b5d72f0cdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9346880b-be8a-437f-9f6b-b91b210079c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9346880b-be8a-437f-9f6b-b91b210079c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-976076095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c67af93-e4f9-4094-a40a-d82fdd02f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ddd5385af40b7a319d00a09b94b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:27Z,use_quota=True,user_id='c10295c3cbcd4e9d9ef9d58b936d5e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67674e51-e26e-4e60-90b1-f77f7caece34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67674e51-e26e-4e60-90b1-f77f7caece34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ff5670-00d7-4205-a2bf-5ac3fc76ad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ff5670-00d7-4205-a2bf-5ac3fc76ad7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c67af93-e4f9-4094-a40a-d82fdd02f2a5', 'volume_name': 'volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc15993d-3bc4-4344-afcf-33f2bf9a4d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc15993d-3bc4-4344-afcf-33f2bf9a4d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b53e10-7a38-440e-bd6e-29f5937d2185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Volume 7c67af93-e4f9-4094-a40a-d82fdd02f2a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5', 'volume_size': 1} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-976076095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c67af93-e4f9-4094-a40a-d82fdd02f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc2ddd5385af40b7a319d00a09b94b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:27Z,use_quota=True,user_id='c10295c3cbcd4e9d9ef9d58b936d5e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Creating volume 7c67af93-e4f9-4094-a40a-d82fdd02f2a5 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:27 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:27 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 1073741824 Sep 28 17:16:27 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-002e2d8d-9784-46bd-baa0-e70a89d7428c tempest-VolumesTransfersV355Test-358203092 None] Transfer volume completed successfully. Sep 28 17:16:28 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 1073741824" returned: 0 in 0.958s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:28 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 Sep 28 17:16:28 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:28 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" returned: 0 in 0.597s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59b53e10-7a38-440e-bd6e-29f5937d2185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953e4949-e03b-4bec-88d1-ebe16df5a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Volume volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 (7c67af93-e4f9-4094-a40a-d82fdd02f2a5): created successfully Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953e4949-e03b-4bec-88d1-ebe16df5a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Flow 'volume_create_manager' (40504011-8293-4a2e-998e-5b5d72f0cdda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-97d80a1a-25ba-40ea-a731-70348d67c350 tempest-VolumesTransfersTest-909722507 None] Created volume successfully. Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "cinder-de8dba6b-4d93-4d52-bd8b-99b4e4044451-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-de8dba6b-4d93-4d52-bd8b-99b4e4044451-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "cinder-quobyte-de8dba6b-4d93-4d52-bd8b-99b4e4044451" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-quobyte-de8dba6b-4d93-4d52-bd8b-99b4e4044451" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6b502f-bf1f-43b2-90af-30674065d3ea]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:29 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 Sep 28 17:16:29 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "cinder-7c67af93-e4f9-4094-a40a-d82fdd02f2a5-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-7c67af93-e4f9-4094-a40a-d82fdd02f2a5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:29 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=98,cinder:INSERT=30,cinder:UPDATE=143,cinder:DELETE=14 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "cinder-quobyte-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-quobyte-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2dca38-7102-4f1a-8a95-a492371433df]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451" returned: 0 in 0.615s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[100144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451 Sep 28 17:16:30 devstack sudo[100144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 Sep 28 17:16:30 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack sudo[100144]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8dba6b-4d93-4d52-bd8b-99b4e4044451" returned: 0 in 0.360s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-quobyte-de8dba6b-4d93-4d52-bd8b-99b4e4044451" released by "delete_volume" :: held 1.052s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:30 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" returned: 0 in 0.538s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5 Sep 28 17:16:30 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Created reservations ['d1f695f9-c108-42b1-9d68-cc3c7f2bff4d', 'ed113420-3204-46bf-8484-0b3baa467739', 'e438ba04-40db-4adc-b817-b1ea40ed52e1', '212bb438-7e58-4eb4-856d-bb43d46cace4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:30 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:30 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" returned: 0 in 0.370s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-quobyte-7c67af93-e4f9-4094-a40a-d82fdd02f2a5" released by "delete_volume" :: held 1.003s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Created reservations ['e189ff8e-0a75-4875-a91f-422c16fe1d83', 'f9fedb95-175e-432f-9357-5cf9895b3bc8', '93e6c785-8e78-4734-aeac-7ecde047f553', 'e97a64a8-ebb5-46ae-847e-6073a1d76e71'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:31 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.350s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Deleted volume successfully. Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-47b05f33-c4d8-44f7-95aa-90617baeb7fd tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-de8dba6b-4d93-4d52-bd8b-99b4e4044451-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:31 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:31 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:31 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Deleted volume successfully. Sep 28 17:16:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0af22dbe-c2e7-48b6-8272-fb5adb18e580 tempest-VolumesTransfersTest-1605462361 None] Lock "cinder-7c67af93-e4f9-4094-a40a-d82fdd02f2a5-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Flow 'volume_create_manager' (b20b2e06-7514-41aa-b48b-c9c0002e18ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02670a6a-fa64-41b5-94d0-d7f6fa1707df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02670a6a-fa64-41b5-94d0-d7f6fa1707df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1156141314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2843ddab-9ca9-405a-9e4f-5bac4c3582b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa2671a19ea4998b27ea5eb9a3e53fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:33Z,use_quota=True,user_id='ecbbd68ac8eb4fcab8722b30198e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd09c5a5-c455-4571-bdbb-97fd2c4e8bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd09c5a5-c455-4571-bdbb-97fd2c4e8bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74b8f15-cf9d-496e-9f6d-603a6f6a9580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a74b8f15-cf9d-496e-9f6d-603a6f6a9580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2843ddab-9ca9-405a-9e4f-5bac4c3582b0', 'volume_name': 'volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254d8f5e-4317-4838-92e8-c57280ac8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254d8f5e-4317-4838-92e8-c57280ac8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc9c4b-8ea0-4943-8f15-5241d748694d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Volume 2843ddab-9ca9-405a-9e4f-5bac4c3582b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0', 'volume_size': 1} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1156141314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2843ddab-9ca9-405a-9e4f-5bac4c3582b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfa2671a19ea4998b27ea5eb9a3e53fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:33Z,use_quota=True,user_id='ecbbd68ac8eb4fcab8722b30198e42bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Creating volume 2843ddab-9ca9-405a-9e4f-5bac4c3582b0 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:32 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 1073741824 Sep 28 17:16:33 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 1073741824" returned: 0 in 0.751s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0686fb52-b072-4656-83d5-ce3fa15c67dd tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" by "attach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0686fb52-b072-4656-83d5-ce3fa15c67dd tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" acquired by "attach_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:33 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 Sep 28 17:16:33 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0686fb52-b072-4656-83d5-ce3fa15c67dd tempest-VolumesActionsTest-1454502236 None] Attaching volume 874a4cc5-183b-49b2-b407-10458f02d254 to instance 9524df3b-8150-467a-8c59-eb5fbd50f096 at mountpoint /dev/vdb on host None. Sep 28 17:16:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0686fb52-b072-4656-83d5-ce3fa15c67dd tempest-VolumesActionsTest-1454502236 None] Attach volume completed successfully. Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0686fb52-b072-4656-83d5-ce3fa15c67dd tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" released by "attach_volume" :: held 0.244s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:34 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-627c6c7d-cb77-4d76-a144-419acfb93d87 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" by "detach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-627c6c7d-cb77-4d76-a144-419acfb93d87 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-627c6c7d-cb77-4d76-a144-419acfb93d87 tempest-VolumesActionsTest-1454502236 None] Detaching volume 874a4cc5-183b-49b2-b407-10458f02d254 from instance 9524df3b-8150-467a-8c59-eb5fbd50f096. Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbc9c4b-8ea0-4943-8f15-5241d748694d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99cd46e-7796-48c3-b994-7d48a6305db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Volume volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 (2843ddab-9ca9-405a-9e4f-5bac4c3582b0): created successfully Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99cd46e-7796-48c3-b994-7d48a6305db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Flow 'volume_create_manager' (b20b2e06-7514-41aa-b48b-c9c0002e18ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-95e563c0-2ae8-41f9-a20b-5f136acda179 tempest-VolumesTransfersV355Test-1706668601 None] Created volume successfully. Sep 28 17:16:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-627c6c7d-cb77-4d76-a144-419acfb93d87 tempest-VolumesActionsTest-1454502236 None] Detach volume completed successfully. Sep 28 17:16:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-627c6c7d-cb77-4d76-a144-419acfb93d87 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" released by "detach_volume" :: held 0.156s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "cinder-2843ddab-9ca9-405a-9e4f-5bac4c3582b0-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-2843ddab-9ca9-405a-9e4f-5bac4c3582b0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "cinder-quobyte-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-quobyte-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ff4d09-c9c7-4893-8251-686cba9d9494]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:35 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 Sep 28 17:16:35 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" returned: 0 in 0.476s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0 Sep 28 17:16:36 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:36 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" returned: 0 in 0.391s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-quobyte-2843ddab-9ca9-405a-9e4f-5bac4c3582b0" released by "delete_volume" :: held 0.935s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Created reservations ['651933c9-c820-4240-a2b6-d3af41beb6c4', 'cf43faad-331f-48aa-b194-2a5089b24d50', '5b09b871-2e71-4b60-a32c-318ff3298eea', '552bbb1c-5b42-4405-b3a0-961a5afef6be'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:36 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:36 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:37 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.362s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:37 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:37 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Deleted volume successfully. Sep 28 17:16:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-90c2393d-4504-4cd2-9bac-6a6a3f74d980 tempest-VolumesTransfersV355Test-1644579861 None] Lock "cinder-2843ddab-9ca9-405a-9e4f-5bac4c3582b0-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=105,cinder:INSERT=36,cinder:UPDATE=142,cinder:DELETE=13 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Flow 'volume_create_manager' (c6996cbf-9764-4f86-ad18-b3ba3ed1dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a803dc-aca9-4874-b1e7-2d9673bccefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33a803dc-aca9-4874-b1e7-2d9673bccefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2078585277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159ed50d-bbd8-49c1-9303-d62c55c526f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7bed36659f4ca19958bf88c5fa4476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='78f97461bbc6446885f5b79c4925774e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f107812b-276a-4fea-869e-d401296bce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f107812b-276a-4fea-869e-d401296bce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2917184-b6d7-4e56-9344-d32bbbd0b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2917184-b6d7-4e56-9344-d32bbbd0b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159ed50d-bbd8-49c1-9303-d62c55c526f9', 'volume_name': 'volume-159ed50d-bbd8-49c1-9303-d62c55c526f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d220d78c-5d6a-4332-837d-1ed4ee395701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d220d78c-5d6a-4332-837d-1ed4ee395701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db963ed3-bb23-4215-ac1d-a45a895d1eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:44 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Volume 159ed50d-bbd8-49c1-9303-d62c55c526f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159ed50d-bbd8-49c1-9303-d62c55c526f9', 'volume_size': 1} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2078585277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159ed50d-bbd8-49c1-9303-d62c55c526f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7bed36659f4ca19958bf88c5fa4476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:44Z,use_quota=True,user_id='78f97461bbc6446885f5b79c4925774e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Creating volume 159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:16:44 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 1073741824 Sep 28 17:16:44 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:44 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:16:44 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:44 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 1073741824" returned: 0 in 0.790s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:44 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.469s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:45 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:16:45 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:45 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.355s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db963ed3-bb23-4215-ac1d-a45a895d1eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159ed50d-bbd8-49c1-9303-d62c55c526f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee7a598-323b-4f3a-99fb-248e22a9c6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:45 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Volume volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 (159ed50d-bbd8-49c1-9303-d62c55c526f9): created successfully Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee7a598-323b-4f3a-99fb-248e22a9c6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Flow 'volume_create_manager' (c6996cbf-9764-4f86-ad18-b3ba3ed1dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fe9a5379-5592-49f6-adeb-ad369066eaa0 tempest-VolumesCloneTest-1397429950 None] Created volume successfully. Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Flow 'volume_create_manager' (7a100493-a215-4181-956e-a3ce4b517fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babeddf2-4e64-4772-a4a8-cc7deb910efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (babeddf2-4e64-4772-a4a8-cc7deb910efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1116440720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ef61f0-3cd9-4511-b60c-a1edaeb67b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7bed36659f4ca19958bf88c5fa4476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=159ed50d-bbd8-49c1-9303-d62c55c526f9,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:47Z,use_quota=True,user_id='78f97461bbc6446885f5b79c4925774e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ada858e-c249-463a-831a-17a17a011d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ada858e-c249-463a-831a-17a17a011d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6beadba-7557-4a48-94d9-36046831b70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6beadba-7557-4a48-94d9-36046831b70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '09ef61f0-3cd9-4511-b60c-a1edaeb67b45', 'volume_name': 'volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45', 'volume_size': 2, 'source_volid': '159ed50d-bbd8-49c1-9303-d62c55c526f9', 'source_volstatus': 'available'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611548f1-c1a2-4944-a0e0-ca7381f432e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (611548f1-c1a2-4944-a0e0-ca7381f432e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97466d2-6731-4758-938a-0180990d00c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Volume 09ef61f0-3cd9-4511-b60c-a1edaeb67b45: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45', 'volume_size': 2, 'source_volid': '159ed50d-bbd8-49c1-9303-d62c55c526f9', 'source_volstatus': 'available'} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:47 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Cloning volume 159ed50d-bbd8-49c1-9303-d62c55c526f9 to volume 09ef61f0-3cd9-4511-b60c-a1edaeb67b45 Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Creating offline snapshot 7f2da539-8061-4d7e-a480-80eabfd19c32 of volume 159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea85932-b01d-46ae-839f-3858d12007b6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:48 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:16:48 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:48 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.680s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:48 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 1G Sep 28 17:16:48 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 1G" returned: 0 in 0.760s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:16:49 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:49 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.658s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:49 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 is being set with open permissions: ugo+rw Sep 28 17:16:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:49 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:16:50 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:16:50 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Flow 'volume_create_manager' (553761d2-7fab-4e8c-8dd1-d651f5b79a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c89e6-5888-42e6-a2fd-77f0babd7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.572s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (031c89e6-5888-42e6-a2fd-77f0babd7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053484515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b35147-095d-402f-9281-1fc1020e4647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b549866396f54a4fb879d4fa51aad3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:50Z,use_quota=True,user_id='76b004a582cc44a489abe32fcb988d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3e1eee-2d62-4e8c-8f60-325d74d8e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3e1eee-2d62-4e8c-8f60-325d74d8e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c26809-b0c6-403f-a9cb-c2eba9123509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c26809-b0c6-403f-a9cb-c2eba9123509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b35147-095d-402f-9281-1fc1020e4647', 'volume_name': 'volume-11b35147-095d-402f-9281-1fc1020e4647', 'volume_size': 2}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec97cc8b-dbbf-4a76-85d2-b11d3135b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec97cc8b-dbbf-4a76-85d2-b11d3135b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90daed63-8a6f-4dbb-8ce5-3fbc82d4a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:16:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Volume 11b35147-095d-402f-9281-1fc1020e4647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b35147-095d-402f-9281-1fc1020e4647', 'volume_size': 2} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info Sep 28 17:16:50 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:50 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:50 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info is being set with open permissions: ugo+rw Sep 28 17:16:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:50 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info Sep 28 17:16:50 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.info" returned: 0 in 0.350s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] snapshot: 7f2da539-8061-4d7e-a480-80eabfd19c32, volume: 09ef61f0-3cd9-4511-b60c-a1edaeb67b45, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206b6b3-8328-4256-8df5-31734476de44]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:51 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:16:51 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f41d678c-494f-4274-81d6-8228fbafc87a tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" by "attach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f41d678c-494f-4274-81d6-8228fbafc87a tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" acquired by "attach_volume" :: waited 0.047s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f41d678c-494f-4274-81d6-8228fbafc87a tempest-VolumesActionsTest-1454502236 None] Attaching volume 874a4cc5-183b-49b2-b407-10458f02d254 to instance 3831ef53-6ec4-4235-a1b8-c031ee1fb651 at mountpoint /dev/vdb on host None. Sep 28 17:16:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f41d678c-494f-4274-81d6-8228fbafc87a tempest-VolumesActionsTest-1454502236 None] Attach volume completed successfully. Sep 28 17:16:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f41d678c-494f-4274-81d6-8228fbafc87a tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254" released by "attach_volume" :: held 0.186s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:52 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.649s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159ed50d-bbd8-49c1-9303-d62c55c526f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d38b78-45e8-4fd2-9ec1-e09a9d4427bb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:16:52 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-483f204e-09aa-4088-a61f-ba1ca3cdf041 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" by "detach_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-483f204e-09aa-4088-a61f-ba1ca3cdf041 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:16:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-483f204e-09aa-4088-a61f-ba1ca3cdf041 tempest-VolumesActionsTest-1454502236 None] Detaching volume 874a4cc5-183b-49b2-b407-10458f02d254 from instance 3831ef53-6ec4-4235-a1b8-c031ee1fb651. Sep 28 17:16:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-483f204e-09aa-4088-a61f-ba1ca3cdf041 tempest-VolumesActionsTest-1454502236 None] Detach volume completed successfully. Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-483f204e-09aa-4088-a61f-ba1ca3cdf041 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:16:52 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.550s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:16:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:16:52 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 Sep 28 17:16:52 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" returned: 0 in 7.961s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9, size 1024.00 MB, duration 7.96 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:00 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Converted 1024.00 MB image at 128.61 MB/s Sep 28 17:17:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 is being set with open permissions: ugo+rw Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:00 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 Sep 28 17:17:00 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:00 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" returned: 0 in 0.270s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" released by "_copy_volume_from_snapshot" :: held 9.558s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-quobyte-7f2da539-8061-4d7e-a480-80eabfd19c32" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-7f2da539-8061-4d7e-a480-80eabfd19c32" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Deleting offline snapshot 7f2da539-8061-4d7e-a480-80eabfd19c32 of volume 159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] snapshot_file for this snap is: volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd0a809-a15f-4106-9552-862581fc7efe]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:17:01 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:01 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-159ed50d-bbd8-49c1-9303-d62c55c526f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b31b9-2755-4506-a1f0-a8795a462ce1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:17:01 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:01 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.525s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:01 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:17:01 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.353s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32 Sep 28 17:17:02 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9.7f2da539-8061-4d7e-a480-80eabfd19c32" returned: 0 in 0.247s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-7f2da539-8061-4d7e-a480-80eabfd19c32" released by "_delete_snapshot" :: held 1.597s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.858s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.029s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2053484515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b35147-095d-402f-9281-1fc1020e4647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b549866396f54a4fb879d4fa51aad3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:16:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:16:50Z,use_quota=True,user_id='76b004a582cc44a489abe32fcb988d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Creating volume 11b35147-095d-402f-9281-1fc1020e4647 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:02 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 2147483648 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:02 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 2147483648 Sep 28 17:17:02 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97466d2-6731-4758-938a-0180990d00c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45', 'volume_size': 2, 'source_volid': '159ed50d-bbd8-49c1-9303-d62c55c526f9', 'source_volstatus': 'available'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1463ae92-f0cb-4190-b5e2-329de34b269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Volume volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 (09ef61f0-3cd9-4511-b60c-a1edaeb67b45): created successfully Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1463ae92-f0cb-4190-b5e2-329de34b269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Flow 'volume_create_manager' (7a100493-a215-4181-956e-a3ce4b517fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9fc87dba-67fe-46f4-805b-5b391f4225cb tempest-VolumesCloneTest-1397429950 None] Created volume successfully. Sep 28 17:17:03 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 2147483648" returned: 0 in 0.570s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 Sep 28 17:17:03 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-09ef61f0-3cd9-4511-b60c-a1edaeb67b45-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-09ef61f0-3cd9-4511-b60c-a1edaeb67b45-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f36f218-b063-44d3-848d-92eb069b76d8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647" returned: 0 in 0.345s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.815s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90daed63-8a6f-4dbb-8ce5-3fbc82d4a210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b35147-095d-402f-9281-1fc1020e4647', 'volume_size': 2}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ede80a-e5d5-4039-ac94-515f35134cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590b3ee-a68d-4b5f-9945-d43f5216a5be]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Volume volume-11b35147-095d-402f-9281-1fc1020e4647 (11b35147-095d-402f-9281-1fc1020e4647): created successfully Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15ede80a-e5d5-4039-ac94-515f35134cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Flow 'volume_create_manager' (553761d2-7fab-4e8c-8dd1-d651f5b79a3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ba51dc1f-8599-48bd-a2cd-5cc650f6eac7 tempest-VolumesCloneNegativeTest-292448504 None] Created volume successfully. Sep 28 17:17:03 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 Sep 28 17:17:03 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:03 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:03 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" returned: 0 in 0.444s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45 Sep 28 17:17:04 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.441s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39bede-f5a2-4ed7-a0af-2f67ea49ffd8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:04 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-09ef61f0-3cd9-4511-b60c-a1edaeb67b45" released by "delete_volume" :: held 0.803s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Created reservations ['d4e0a8c0-3b0e-4acd-87fa-a9110fbccdf9', '0e02f4bc-ea65-4b0b-9a7e-c9699abcb348', '2e3d6858-2b16-4846-a337-8c45b2c1517d', 'e14c27a6-d90b-4f99-8959-31521eaf0a70'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:04 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.483s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.dd0d931a-8a2a-432b-bbb3-68d9151d457el86zdzni.img {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:04 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.dd0d931a-8a2a-432b-bbb3-68d9151d457el86zdzni.img Sep 28 17:17:04 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-159ed50d-bbd8-49c1-9303-d62c55c526f9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-159ed50d-bbd8-49c1-9303-d62c55c526f9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Acquiring lock "cinder-11b35147-095d-402f-9281-1fc1020e4647-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "cinder-11b35147-095d-402f-9281-1fc1020e4647-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:04 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "cinder-quobyte-159ed50d-bbd8-49c1-9303-d62c55c526f9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Deleted volume successfully. Sep 28 17:17:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-159ed50d-bbd8-49c1-9303-d62c55c526f9" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Acquiring lock "cinder-quobyte-11b35147-095d-402f-9281-1fc1020e4647" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2c10d734-2ba0-471f-9916-1a621de5c0a3 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-09ef61f0-3cd9-4511-b60c-a1edaeb67b45-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed923a1-5ab2-47af-b9d6-cd63d0104a4d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "cinder-quobyte-11b35147-095d-402f-9281-1fc1020e4647" acquired by "delete_volume" :: waited 0.059s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b70083-ca08-4e72-8071-278b541de66f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:17:05 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 Sep 28 17:17:05 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647" returned: 0 in 0.703s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.839s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:05 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647 Sep 28 17:17:05 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:05 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9 Sep 28 17:17:05 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-11b35147-095d-402f-9281-1fc1020e4647" returned: 0 in 0.475s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "cinder-quobyte-11b35147-095d-402f-9281-1fc1020e4647" released by "delete_volume" :: held 1.304s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:06 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-159ed50d-bbd8-49c1-9303-d62c55c526f9" returned: 0 in 0.570s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-quobyte-159ed50d-bbd8-49c1-9303-d62c55c526f9" released by "delete_volume" :: held 1.553s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Created reservations ['0a8982eb-b072-463b-b9ab-c536f1aff75c', 'a7320f4b-f786-4bba-8305-7367a13d3b71', 'c245ada1-fa8d-4e34-aaa0-5896ffe47b17', 'b4720449-aa9c-4d78-a06f-44914e2f2df9'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Created reservations ['77fe5449-69d9-4186-89c2-826b9751e92d', '53ef9fb7-0608-4845-9f2a-3ac829f3ee06', 'd8eebfda-b349-4ef8-b215-d771f068526c', '0f8a8a53-e4dc-4ddd-8016-2633ff5a41f7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:06 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:06 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:06 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:07 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.573s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Deleted volume successfully. Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-54be4f01-ff98-489d-9439-31ad602010c6 tempest-VolumesCloneNegativeTest-292448504 None] Lock "cinder-11b35147-095d-402f-9281-1fc1020e4647-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:07 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.587s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Deleted volume successfully. Sep 28 17:17:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-894f0738-2e3f-466f-b09d-afce8e314cf6 tempest-VolumesCloneTest-1397429950 None] Lock "cinder-159ed50d-bbd8-49c1-9303-d62c55c526f9-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:12 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.dd0d931a-8a2a-432b-bbb3-68d9151d457el86zdzni.img" returned: 0 in 8.004s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9349525f-c162-4b9c-9fcc-bd1d87a58d53]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:12 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:12 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:13 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.653s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:13 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254, size 1024.00 MB, duration 8.01 sec, destination /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.dd0d931a-8a2a-432b-bbb3-68d9151d457el86zdzni.img {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:13 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Converted 1024.00 MB image at 127.89 MB/s Sep 28 17:17:13 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] dd0d931a-8a2a-432b-bbb3-68d9151d457e was raw, no need to convert to raw {{(pid=86842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:17:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Flow 'volume_create_manager' (4f6019ab-138d-4b60-8e99-e6f1aced5051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f00822a-0622-4014-8623-4f9ba399d61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f00822a-0622-4014-8623-4f9ba399d61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1994104469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc44a04c6bc407eb42278c6852a567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:15Z,use_quota=True,user_id='903c5356ba26451ea1f264a30f81ea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e9243d-9306-487d-b15d-427a2eaf7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6e9243d-9306-487d-b15d-427a2eaf7423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e1e379-ff5a-483f-b194-336410f6fe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Flow 'volume_create_manager' (9cfc533b-75ed-4074-8e5c-8b169714008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a860f40-dba4-4354-93a0-2b18dbbd63fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a860f40-dba4-4354-93a0-2b18dbbd63fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1606675803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af99d45973cf4f8b9ed582975de28fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:15Z,use_quota=True,user_id='b30629ce2c4d47a9b7693f4009405e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f848c4-8c7b-4b50-b8f8-6dede86c32de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f848c4-8c7b-4b50-b8f8-6dede86c32de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac705cc-bcbe-4b3c-a0bf-e074462f714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac705cc-bcbe-4b3c-a0bf-e074462f714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc', 'volume_name': 'volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71573192-90d3-4cf8-9868-b0a0ed4a3c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71573192-90d3-4cf8-9868-b0a0ed4a3c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4a74c9-77b8-4752-9705-a5630a9ebeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc', 'volume_size': 1} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2e1e379-ff5a-483f-b194-336410f6fe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc', 'volume_name': 'volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06367fce-38d8-4f5c-9336-07d9b5f0193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06367fce-38d8-4f5c-9336-07d9b5f0193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d477bf2a-289e-44e3-bded-102b0fe18b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:17:15 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Trying to clone 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de at location (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:17:16 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c30c743-685a-4d0d-8fa6-23f071f6545b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:16 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD Sep 28 17:17:16 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:16 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de is fetched for user 903c5356ba26451ea1f264a30f81ea05. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856a15c-ba71-493b-96a0-da9816f8645e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:16 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD Sep 28 17:17:16 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:17 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:26 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=54,cinder:INSERT=17,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:26 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=36,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.555s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Uploaded volume to glance image-id: dd0d931a-8a2a-432b-bbb3-68d9151d457e. {{(pid=86842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.729s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1606675803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af99d45973cf4f8b9ed582975de28fa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:15Z,use_quota=True,user_id='b30629ce2c4d47a9b7693f4009405e5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Creating volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:34 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:34 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc 1073741824 Sep 28 17:17:34 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5e68a9b6-4580-414c-96de-47e609f23e40 tempest-VolumesActionsTest-1454502236 None] Copy volume to image completed successfully. Sep 28 17:17:34 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc 1073741824" returned: 0 in 0.497s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:34 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc Sep 28 17:17:34 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:35 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" returned: 0 in 0.310s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.970s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1994104469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc44a04c6bc407eb42278c6852a567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:15Z,use_quota=True,user_id='903c5356ba26451ea1f264a30f81ea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Creating volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:35 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af4a74c9-77b8-4752-9705-a5630a9ebeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116070a3-83a9-49ac-8bb3-ab1803ec895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:35 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1073741824 Sep 28 17:17:35 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Volume volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc (a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc): created successfully Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116070a3-83a9-49ac-8bb3-ab1803ec895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Flow 'volume_create_manager' (9cfc533b-75ed-4074-8e5c-8b169714008b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ccffc736-3f50-4b48-ade5-9b097c26e8a5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Created volume successfully. Sep 28 17:17:35 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1073741824" returned: 0 in 0.618s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:35 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc Sep 28 17:17:35 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:36 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" returned: 0 in 0.302s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.173s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e71f21-40a4-4f9f-9bfa-4a3dd272f604]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Attempting download of 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6022f24-35cb-4f4f-90e1-093b9c9c18f1]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:36 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:36 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph Sep 28 17:17:36 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:36 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.452s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdc8edb-bede-48e0-bc27-852206e437f0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph" returned: 0 in 0.398s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:36 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:36 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph Sep 28 17:17:36 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:36 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph" returned: 1 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_b3jq7sph' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[53822ef4-34cb-454c-b5f8-c6cb342aea49]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:36 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img Sep 28 17:17:37 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD Sep 28 17:17:37 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:37 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:37 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] 40f838d7-edca-40ca-9cfd-7bbe1f3736de was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:17:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:37 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc Sep 28 17:17:37 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:42 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" returned: 0 in 5.028s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:42 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_elb69q_bdevstack@QuobyteHD, size 112.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:42 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Converted 112.00 MB image at 22.27 MB/s Sep 28 17:17:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:42 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1G Sep 28 17:17:42 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:43 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 1G" returned: 0 in 0.682s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Downloaded image 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de for user 903c5356ba26451ea1f264a30f81ea05 is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Marking volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Copying metadata from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de to 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Creating volume glance metadata for volume 6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc backed by image 40f838d7-edca-40ca-9cfd-7bbe1f3736de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d477bf2a-289e-44e3-bded-102b0fe18b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5ee633-0ec7-4644-ac76-5c65fbcfdf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Volume volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc (6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc): created successfully Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a5ee633-0ec7-4644-ac76-5c65fbcfdf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Flow 'volume_create_manager' (4f6019ab-138d-4b60-8e99-e6f1aced5051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a202b5a1-3ffc-4eef-9335-c9c9183c1541 tempest-VolumesExtendTest-933007580 None] Created volume successfully. Sep 28 17:17:43 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img" returned: 0 in 6.873s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a464714-4a17-4c07-a1b9-c9a492b09bdc]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:43 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:43 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:44 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.562s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:44 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Converted 1024.00 MB image at 148.97 MB/s Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] a0781076-ca16-486b-9b5c-3197abdffa67 was raw, converting to qcow2 {{(pid=86842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[561054f0-fb19-484b-9bf8-7af0d767c8c6]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:44 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:44 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:44 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img Sep 28 17:17:44 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:44 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.295s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:17:44 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:45 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img Sep 28 17:17:45 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img" returned: 1 in 0.404s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv Sep 28 17:17:45 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:45 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Image conversion details: src /opt/stack/data/cinder/conversion/874a4cc5-183b-49b2-b407-10458f02d254.temp_image.a0781076-ca16-486b-9b5c-3197abdffa67hv8oygqy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:17:45 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75778a7-2242-435b-90b0-55978c64208d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:45 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv Sep 28 17:17:45 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:46 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a2s3zpyv" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.530s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Uploaded volume to glance image-id: a0781076-ca16-486b-9b5c-3197abdffa67. {{(pid=86842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.301s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Creating offline snapshot 705afd8a-1d49-4efb-9022-beb0e1cb0b6d of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-daf7bc6c-a66a-4d53-998c-1b0d413ea156 tempest-VolumesActionsTest-1454502236 None] Copy volume to image completed successfully. Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeeb848-317d-44bc-9899-7724d46022d5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:47 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc Sep 28 17:17:47 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:48 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" returned: 0 in 0.403s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d 1G Sep 28 17:17:48 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:48 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d 1G" returned: 0 in 0.505s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:17:48 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:48 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.353s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:48 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d is being set with open permissions: ugo+rw Sep 28 17:17:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:48 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:17:48 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.312s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info Sep 28 17:17:49 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "cinder-quobyte-874a4cc5-183b-49b2-b407-10458f02d254" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-quobyte-874a4cc5-183b-49b2-b407-10458f02d254" acquired by "delete_volume" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f159e5c5-750c-49ad-b7d7-8a9eb09a5072]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info is being set with open permissions: ugo+rw Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info Sep 28 17:17:49 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:49 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:49 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.info" returned: 0 in 0.311s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.358s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.929s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d587e46-dfa7-4b11-a71a-2a3de943c8df]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:49 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.472s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4fa48fff-023b-4aaf-9499-26b2b84ee590 tempest-VolumesSnapshotListTestJSON-1126092573 None] Create snapshot completed successfully Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:50 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254 Sep 28 17:17:50 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:50 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc Sep 28 17:17:50 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:50 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-874a4cc5-183b-49b2-b407-10458f02d254" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-quobyte-874a4cc5-183b-49b2-b407-10458f02d254" released by "delete_volume" :: held 0.846s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Created reservations ['3945e7f0-a5de-42ff-bd78-d4c0b10811ac', '6b08a461-6376-4840-be54-dcf2897335c1', '157686fd-c7a8-446c-a83b-2983d1b0f120', 'e3363cb6-74b8-4fbf-ada4-642b63ec7f9d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:50 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" returned: 0 in 0.460s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 2G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:50 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:50 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc 2G" returned: 0 in 0.179s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.683s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-db48473c-a683-427b-bd49-28537d461af8 tempest-VolumesExtendTest-933007580 None] Extend volume completed successfully. Sep 28 17:17:50 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.362s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Deleted volume successfully. Sep 28 17:17:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6fed4d81-43b3-4077-b1d7-8c504d006ea6 tempest-VolumesActionsTest-1454502236 None] Lock "cinder-874a4cc5-183b-49b2-b407-10458f02d254-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Creating offline snapshot a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aea25b-5f35-4c70-b0dc-d3e813f6a44d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:51 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:17:51 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:51 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.507s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:51 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 1G Sep 28 17:17:51 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "cinder-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-quobyte-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae197744-f9e1-444c-9fae-50c30a0bd20a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:52 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc Sep 28 17:17:52 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:52 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 1G" returned: 0 in 0.730s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:52 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:17:52 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:52 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" returned: 0 in 0.539s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:52 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc Sep 28 17:17:52 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:52 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:52 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 is being set with open permissions: ugo+rw Sep 28 17:17:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:52 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:17:52 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:53 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" returned: 0 in 0.310s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc" released by "delete_volume" :: held 0.932s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Created reservations ['d942fd1f-8406-44e0-b90c-9242914328fc', '75c3bc81-77e6-49ce-a86e-6abfb38caa38', 'c43be106-35ba-493b-b953-050a5a0b1df6', '87c980cb-5509-42c7-9cdb-b8adb8f00ee7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:17:53 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.100s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ca093af0-0a60-4f54-bd9e-b9d8b7aee920 tempest-VolumesSnapshotListTestJSON-1126092573 None] Create snapshot completed successfully Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:53 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:17:53 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:53 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.278s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:17:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Deleted volume successfully. Sep 28 17:17:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-10501c2a-eae1-4585-8a58-17cfa83159f6 tempest-VolumesExtendTest-933007580 None] Lock "cinder-6b9c2f87-67a1-4c3a-9c29-0bceedbff9fc-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:17:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Creating offline snapshot 558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72a61e6-f540-41ec-aeab-0675fe31a43d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:55 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:17:55 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Flow 'volume_create_manager' (468efe5c-3db0-4f6e-b6df-c9018aab48cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f888ac8-e3bf-4639-9892-db09978eaa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f888ac8-e3bf-4639-9892-db09978eaa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1544795805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc44a04c6bc407eb42278c6852a567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:55Z,use_quota=True,user_id='903c5356ba26451ea1f264a30f81ea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001f6d47-d190-4af4-9152-4ed8e7d5738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (001f6d47-d190-4af4-9152-4ed8e7d5738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4687b11-3abd-4771-a790-5c32c630a926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4687b11-3abd-4771-a790-5c32c630a926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7', 'volume_name': 'volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e29bc1-5cdc-4b11-bca5-9e72d5de9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e29bc1-5cdc-4b11-bca5-9e72d5de9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db54ec3f-675c-4d19-aa27-684567ada610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:55 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Volume b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7', 'volume_size': 1} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:55 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.454s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:55 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb 1G Sep 28 17:17:55 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:55 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb 1G" returned: 0 in 0.514s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:55 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb Sep 28 17:17:55 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:56 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" returned: 0 in 0.357s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:56 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb is being set with open permissions: ugo+rw Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:56 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb Sep 28 17:17:56 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:56 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" returned: 0 in 0.332s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:17:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1544795805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bc44a04c6bc407eb42278c6852a567a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:17:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:17:55Z,use_quota=True,user_id='903c5356ba26451ea1f264a30f81ea05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Creating volume b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:17:56 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:17:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:56 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 1073741824 Sep 28 17:17:56 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:56 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-796f22bf-62bc-49c5-81e6-e80ca739fc7b tempest-VolumesSnapshotListTestJSON-1126092573 None] Create snapshot completed successfully Sep 28 17:17:57 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 1073741824" returned: 0 in 0.708s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:57 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:17:57 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:57 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.353s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db54ec3f-675c-4d19-aa27-684567ada610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1605cbcb-97b5-4f64-9617-a3f894bd7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:17:57 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Volume volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 (b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7): created successfully Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1605cbcb-97b5-4f64-9617-a3f894bd7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:17:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Flow 'volume_create_manager' (468efe5c-3db0-4f6e-b6df-c9018aab48cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:17:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-38e3bcf9-eae4-4a3b-923e-0be142ae54f4 tempest-VolumesExtendTest-933007580 None] Created volume successfully. Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Deleting offline snapshot 558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] snapshot_file for this snap is: volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa018e9e-0ef1-44a9-8988-7eddaa256415]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[100787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb Sep 28 17:17:58 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Creating offline snapshot d4805b76-166f-47b9-8229-20d187ff3d1c of volume b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca544704-f52b-45bd-80b8-86e24a897342]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" returned: 0 in 0.565s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8486388-19de-48ce-9a3b-f59f6911c0c9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:17:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:58 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:17:58 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:58 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:17:58 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.499s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c 1G Sep 28 17:17:59 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.553s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb Sep 28 17:17:59 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c 1G" returned: 0 in 0.520s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c Sep 28 17:17:59 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:17:59 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" returned: 0 in 0.560s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:17:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:17:59 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb Sep 28 17:17:59 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c" returned: 0 in 0.363s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c is being set with open permissions: ugo+rw Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c Sep 28 17:18:00 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb" released by "_delete_snapshot" :: held 2.177s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" released by "delete_snapshot" :: held 2.207s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Created reservations ['9f912023-df61-4ab4-8dd7-d88818c83cfa', '150c1ab4-7bd8-4f74-ae20-a924f2224711', 'c5dc9cd5-6d50-427b-8e7c-7a1e14f03a90', '9213b7f7-af7c-42d8-8306-e0e32e73c815'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:00 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Delete snapshot completed successfully. Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fe271979-6049-4f49-9b46-a11d5f9d4491 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-558f1b6f-2f40-48c9-9a3c-ec5e8b5b7dfb-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info Sep 28 17:18:00 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:00 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info" returned: 0 in 0.306s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info is being set with open permissions: ugo+rw Sep 28 17:18:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:00 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info Sep 28 17:18:00 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:01 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.info" returned: 0 in 0.389s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4adf569f-f286-43bf-9695-5b08824bb621 tempest-VolumesExtendTest-933007580 None] Create snapshot completed successfully Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Deleting offline snapshot a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] snapshot_file for this snap is: volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4921de38-d2b6-4c19-b2ae-90bc3f9fdd58]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:01 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:18:01 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af378a4-9c90-4a6f-accc-fbdac5391f8d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.624s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:02 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:18:02 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efc23ee-e3ed-4131-a327-61c1777efac7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:18:02 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.600s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c 2G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.528s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:02 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:18:02 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c 2G" returned: 0 in 0.200s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.864s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-983a52bb-a07a-4abe-9878-0361656262c9 tempest-VolumesExtendTest-933007580 None] Extend volume completed successfully. Sep 28 17:18:03 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.487s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:03 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0 Sep 28 17:18:03 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:03 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" returned: 0 in 0.310s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-d4805b76-166f-47b9-8229-20d187ff3d1c-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0" released by "_delete_snapshot" :: held 2.125s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" released by "delete_snapshot" :: held 2.167s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-d4805b76-166f-47b9-8229-20d187ff3d1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-quobyte-d4805b76-166f-47b9-8229-20d187ff3d1c" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-d4805b76-166f-47b9-8229-20d187ff3d1c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Deleting offline snapshot d4805b76-166f-47b9-8229-20d187ff3d1c of volume b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] snapshot_file for this snap is: volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f09264-6ff8-4903-b5b8-13420e26caac]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Created reservations ['a062f355-223b-48fc-8ac4-f202e599765f', 'b4989831-5a8c-4ced-adb1-266536021a86', '4bf9c09e-a769-4d5a-aff7-6c3a1beddb16', 'ab0d88f2-9610-419c-a48d-0b65382a442c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Delete snapshot completed successfully. Sep 28 17:18:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4f11643c-aac5-4171-bf13-ad272590085d tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-a3cdb892-83bb-4aff-87c9-ac7dc941a7f0-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:03 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c Sep 28 17:18:03 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2775d2c4-a98a-453a-8dee-9ca941f679bd]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:18:04 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-705afd8a-1d49-4efb-9022-beb0e1cb0b6d-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-705afd8a-1d49-4efb-9022-beb0e1cb0b6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-705afd8a-1d49-4efb-9022-beb0e1cb0b6d" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-705afd8a-1d49-4efb-9022-beb0e1cb0b6d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Deleting offline snapshot 705afd8a-1d49-4efb-9022-beb0e1cb0b6d of volume a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:04 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] snapshot_file for this snap is: volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.556s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1af83b-8edf-43b9-9f4d-0879781113f6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:04 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c Sep 28 17:18:04 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:18:05 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c" returned: 0 in 0.512s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:05 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.519s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:05 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c Sep 28 17:18:05 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[10935834-d31e-4c05-91c0-d0839bcbb217]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:05 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc Sep 28 17:18:05 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:05 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7.d4805b76-166f-47b9-8229-20d187ff3d1c" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-d4805b76-166f-47b9-8229-20d187ff3d1c" released by "_delete_snapshot" :: held 2.008s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" released by "delete_snapshot" :: held 2.047s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Created reservations ['b5c6f3d4-130e-4141-9087-59ccf13fe1bd', '673634fe-3617-4a9f-a8a0-8ab13836dc0b', 'c2a13272-4a0b-4171-b5bf-3cf5c99773c5', '9ba566d1-5a51-40d1-88f1-353d49e7daf2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:05 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" returned: 0 in 0.505s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:18:06 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Delete snapshot completed successfully. Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2d142ab-00e7-4efb-929d-eafd8a8f5c21 tempest-VolumesExtendTest-933007580 None] Lock "cinder-d4805b76-166f-47b9-8229-20d187ff3d1c-delete_snapshot" released by "delete_snapshot" :: held 2.317s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:06 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:06 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d Sep 28 17:18:06 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:06 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc.705afd8a-1d49-4efb-9022-beb0e1cb0b6d" returned: 0 in 0.308s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-705afd8a-1d49-4efb-9022-beb0e1cb0b6d" released by "_delete_snapshot" :: held 1.920s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" released by "delete_snapshot" :: held 1.947s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Created reservations ['0ef71b85-ba6d-45de-b939-8ea4f38ba274', '1f94df49-6a8f-425b-9b41-c162af407dd4', 'd08575a5-40a7-4187-9081-62e4c9306034', '02d05f9e-9ce0-4d65-b9ee-bbe0c984624c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Delete snapshot completed successfully. Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4879daa3-9d44-4f98-9ddd-fad60707ce86 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-705afd8a-1d49-4efb-9022-beb0e1cb0b6d-delete_snapshot" released by "delete_snapshot" :: held 2.333s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "cinder-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Acquiring lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bddcfd-2e4c-43fa-9dbe-f38417966c24]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:18:07 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:07 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.485s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:07 devstack sudo[100907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7 Sep 28 17:18:07 devstack sudo[100907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:08 devstack sudo[100907]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" returned: 0 in 0.367s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "cinder-quobyte-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7" released by "delete_volume" :: held 0.957s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" acquired by "delete_volume" :: waited 0.035s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a46173-a79e-4574-b124-d7da6e917903]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Created reservations ['38cd8dd2-43c0-48aa-a463-923a6b7650d8', '7f117faa-8f3d-461f-bced-d1ef27e543a5', 'a0d04d4e-2aca-41e4-9292-be124ef3ee8d', '844aa653-24a0-4031-8cd1-85ae02770af5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:08 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc Sep 28 17:18:08 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:08 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Deleted volume successfully. Sep 28 17:18:08 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" returned: 0 in 0.550s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:08 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc Sep 28 17:18:08 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-eedbf35a-a527-4e59-a74f-d9db9859983b tempest-VolumesExtendTest-933007580 None] Lock "cinder-b137ff5f-c8e1-4776-a5a2-cdeece6a3cd7-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:09 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" returned: 0 in 0.322s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-quobyte-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc" released by "delete_volume" :: held 0.973s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Created reservations ['0842c5b2-364d-496f-a3ca-8d841b13459f', 'f587b868-5137-4e01-abac-b4cb5266140b', '8ea0b2c2-3df2-4611-9670-57127a0fc535', 'e9e9f6cd-ed96-4c96-a79e-696937250d21'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:09 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:09 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:09 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Deleted volume successfully. Sep 28 17:18:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30158db1-c5e4-42b3-8aa0-c6cb20f35fe5 tempest-VolumesSnapshotListTestJSON-1126092573 None] Lock "cinder-a6b4aaf3-c0d7-4cb0-b02f-c9231bd686bc-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (b85d16a9-b311-41c2-b625-b6822da5d1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c7d9c4-3ab0-4836-8990-d951a3b77f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c7d9c4-3ab0-4836-8990-d951a3b77f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-115488197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f3f28c-c357-4ee3-92e8-b8ce139a8b12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:15Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375ead7-be90-4b46-8659-6fc282e396c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f375ead7-be90-4b46-8659-6fc282e396c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7572d2b2-43d1-4f83-aab8-26716d9f65cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7572d2b2-43d1-4f83-aab8-26716d9f65cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f3f28c-c357-4ee3-92e8-b8ce139a8b12', 'volume_name': 'volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee953f92-f9e3-471b-8b56-2983d2d368f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee953f92-f9e3-471b-8b56-2983d2d368f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57571521-0715-46f9-8555-12496b58eb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Volume 55f3f28c-c357-4ee3-92e8-b8ce139a8b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12', 'volume_size': 1} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-115488197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f3f28c-c357-4ee3-92e8-b8ce139a8b12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:15Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Creating volume 55f3f28c-c357-4ee3-92e8-b8ce139a8b12 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:15 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:15 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 1073741824 Sep 28 17:18:15 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:15 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 1073741824" returned: 0 in 0.691s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:15 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 Sep 28 17:18:15 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:16 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" returned: 0 in 0.324s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57571521-0715-46f9-8555-12496b58eb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5764baa6-a567-4690-a5cc-9f7d329ca9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Volume volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 (55f3f28c-c357-4ee3-92e8-b8ce139a8b12): created successfully Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5764baa6-a567-4690-a5cc-9f7d329ca9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (b85d16a9-b311-41c2-b625-b6822da5d1ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5b12980d-1f7f-4f10-ae81-979c2f7542d0 tempest-VolumesListTestJSON-2059230395 None] Created volume successfully. Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (7f44ba5c-70a5-444f-a880-9fdedebb3a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d4151-5982-444c-8956-80e6084be365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68d4151-5982-444c-8956-80e6084be365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630556083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1593efc-08c7-4ff3-b277-6eec486bbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:17Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b868db0e-0af0-449a-99da-6a5804f670b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b868db0e-0af0-449a-99da-6a5804f670b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd34eb9-fd75-4e18-bc41-8df8aac3b63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd34eb9-fd75-4e18-bc41-8df8aac3b63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1593efc-08c7-4ff3-b277-6eec486bbaad', 'volume_name': 'volume-e1593efc-08c7-4ff3-b277-6eec486bbaad', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1b43ae-bd0a-4549-b640-939793fbe26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad1b43ae-bd0a-4549-b640-939793fbe26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e974a4-4acb-41fe-b055-601d6054c3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Volume e1593efc-08c7-4ff3-b277-6eec486bbaad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1593efc-08c7-4ff3-b277-6eec486bbaad', 'volume_size': 1} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1630556083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1593efc-08c7-4ff3-b277-6eec486bbaad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:17Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Creating volume e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:17 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:17 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad 1073741824 Sep 28 17:18:17 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (2303634f-f7f2-4c7d-9a50-6079717987a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ea3419-7e4a-4e77-bf28-0b1c56189db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ea3419-7e4a-4e77-bf28-0b1c56189db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-592128977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5919155c-1085-46e7-8122-5ae9d26d7eda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:18Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b819ead6-ccc4-4ca1-b79d-c867de822402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b819ead6-ccc4-4ca1-b79d-c867de822402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e75b3e7-bfde-42ab-b1aa-747d6a57ed47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e75b3e7-bfde-42ab-b1aa-747d6a57ed47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5919155c-1085-46e7-8122-5ae9d26d7eda', 'volume_name': 'volume-5919155c-1085-46e7-8122-5ae9d26d7eda', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beee956-7cfb-4775-99d7-7c0e533b9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9beee956-7cfb-4775-99d7-7c0e533b9d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d694fdd-3c93-4594-b5bc-86d642e031df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Volume 5919155c-1085-46e7-8122-5ae9d26d7eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5919155c-1085-46e7-8122-5ae9d26d7eda', 'volume_size': 1} Sep 28 17:18:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:17 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad 1073741824" returned: 0 in 0.543s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:18 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad Sep 28 17:18:18 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:18 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-592128977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5919155c-1085-46e7-8122-5ae9d26d7eda,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:18Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Creating volume 5919155c-1085-46e7-8122-5ae9d26d7eda {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:18 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88e974a4-4acb-41fe-b055-601d6054c3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1593efc-08c7-4ff3-b277-6eec486bbaad', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:18 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda 1073741824 Sep 28 17:18:18 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469a97b7-dbba-4379-8952-d4da1512c58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Volume volume-e1593efc-08c7-4ff3-b277-6eec486bbaad (e1593efc-08c7-4ff3-b277-6eec486bbaad): created successfully Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469a97b7-dbba-4379-8952-d4da1512c58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (7f44ba5c-70a5-444f-a880-9fdedebb3a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-253d299f-a66b-417f-9edd-a8fcc190284b tempest-VolumesSnapshotTestJSON-443050478 None] Created volume successfully. Sep 28 17:18:18 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda 1073741824" returned: 0 in 0.555s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:19 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda Sep 28 17:18:19 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:19 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d694fdd-3c93-4594-b5bc-86d642e031df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5919155c-1085-46e7-8122-5ae9d26d7eda', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc65a06e-96fe-4454-9bd6-d26cfc6e99b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Volume volume-5919155c-1085-46e7-8122-5ae9d26d7eda (5919155c-1085-46e7-8122-5ae9d26d7eda): created successfully Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc65a06e-96fe-4454-9bd6-d26cfc6e99b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (2303634f-f7f2-4c7d-9a50-6079717987a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9e7c7ece-f07e-4202-8db5-2746bf4c3321 tempest-VolumesListTestJSON-2059230395 None] Created volume successfully. Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Creating offline snapshot beade44a-87a5-46b2-8648-c3d2c9dc15ba of volume e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[22789f19-291f-4428-8d33-799e37bd8617]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:20 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad Sep 28 17:18:20 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:20 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad" returned: 0 in 0.535s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:20 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba 1G Sep 28 17:18:20 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (302fb22b-166b-4f91-b939-8eb2fecb0c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705ee87e-0998-47c8-bbdc-2c07052ab9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (705ee87e-0998-47c8-bbdc-2c07052ab9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292906457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96b943d-8686-4a14-bf75-3abdeacb69a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:21Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5057fc-3f83-4877-86cc-0169e237944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe5057fc-3f83-4877-86cc-0169e237944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e881f-b1cf-4eaf-9a6c-4f874a73f1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (850e881f-b1cf-4eaf-9a6c-4f874a73f1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96b943d-8686-4a14-bf75-3abdeacb69a0', 'volume_name': 'volume-b96b943d-8686-4a14-bf75-3abdeacb69a0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869f6bff-b45d-4d59-a54f-427144267e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (869f6bff-b45d-4d59-a54f-427144267e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb2a5bf-cfcd-46be-ac8e-8c3d9bab6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Volume b96b943d-8686-4a14-bf75-3abdeacb69a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96b943d-8686-4a14-bf75-3abdeacb69a0', 'volume_size': 1} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:20 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba 1G" returned: 0 in 0.496s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1593efc-08c7-4ff3-b277-6eec486bbaad -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:20 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1593efc-08c7-4ff3-b277-6eec486bbaad -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba Sep 28 17:18:20 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:21 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1593efc-08c7-4ff3-b277-6eec486bbaad -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba" returned: 0 in 0.424s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:21 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba is being set with open permissions: ugo+rw Sep 28 17:18:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:21 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba Sep 28 17:18:21 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:21 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba" returned: 0 in 0.289s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:21 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info Sep 28 17:18:21 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:21 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info" returned: 0 in 0.324s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:22 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info is being set with open permissions: ugo+rw Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:22 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info Sep 28 17:18:22 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:22 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.info" returned: 0 in 0.330s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.618s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1292906457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96b943d-8686-4a14-bf75-3abdeacb69a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c5947e741f5544668fb080fbf1b52739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:21Z,use_quota=True,user_id='92bed846e8ec4edf9e07e1ef33523384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Creating volume b96b943d-8686-4a14-bf75-3abdeacb69a0 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:22 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:22 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 1073741824 Sep 28 17:18:22 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-89a55e6f-bf31-4fdd-bb5a-8e478a7207c1 tempest-VolumesSnapshotTestJSON-443050478 None] Create snapshot completed successfully Sep 28 17:18:23 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 1073741824" returned: 0 in 0.647s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:23 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 Sep 28 17:18:23 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-beade44a-87a5-46b2-8648-c3d2c9dc15ba-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-beade44a-87a5-46b2-8648-c3d2c9dc15ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-beade44a-87a5-46b2-8648-c3d2c9dc15ba" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-beade44a-87a5-46b2-8648-c3d2c9dc15ba" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Deleting offline snapshot beade44a-87a5-46b2-8648-c3d2c9dc15ba of volume e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] snapshot_file for this snap is: volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[16db967d-b310-43af-8932-d38ae80c5df9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:23 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0" returned: 0 in 0.562s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb2a5bf-cfcd-46be-ac8e-8c3d9bab6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96b943d-8686-4a14-bf75-3abdeacb69a0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee47de5d-3aee-4d14-972c-67b4f9f64eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Volume volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 (b96b943d-8686-4a14-bf75-3abdeacb69a0): created successfully Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee47de5d-3aee-4d14-972c-67b4f9f64eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Flow 'volume_create_manager' (302fb22b-166b-4f91-b939-8eb2fecb0c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:23 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b25c6bba-9766-4ad3-96ff-ffd04978fc9b tempest-VolumesListTestJSON-2059230395 None] Created volume successfully. Sep 28 17:18:23 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba Sep 28 17:18:23 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:24 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba" returned: 0 in 0.714s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1593efc-08c7-4ff3-b277-6eec486bbaad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53655a-0f31-4494-b296-c4a0d4217602]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:24 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad Sep 28 17:18:24 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:24 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad" returned: 0 in 0.585s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:24 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba Sep 28 17:18:24 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:25 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba" returned: 0 in 0.472s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:25 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba Sep 28 17:18:25 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:25 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad.beade44a-87a5-46b2-8648-c3d2c9dc15ba" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-beade44a-87a5-46b2-8648-c3d2c9dc15ba" released by "_delete_snapshot" :: held 2.331s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" released by "delete_snapshot" :: held 2.369s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['fd979aa9-254d-41da-b938-04bdc604af80', '87f305b2-9fa8-430a-9593-5a6f0786c97d', '4c9b8cdc-06df-49be-9fc9-0845a9bc6f06', 'ab22a583-4dc2-49d6-a6b2-8c8b5d80bd24'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Delete snapshot completed successfully. Sep 28 17:18:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9c2cc04c-6d30-4aa9-b5ea-3ad0b2f7bfb1 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-beade44a-87a5-46b2-8648-c3d2c9dc15ba-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-b96b943d-8686-4a14-bf75-3abdeacb69a0-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-b96b943d-8686-4a14-bf75-3abdeacb69a0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=87,cinder:UPDATE=93,cinder:INSERT=30,cinder:DELETE=9 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=96,cinder:SELECT=96,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-quobyte-b96b943d-8686-4a14-bf75-3abdeacb69a0" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-b96b943d-8686-4a14-bf75-3abdeacb69a0" acquired by "delete_volume" :: waited 0.046s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4e67ac-8b03-4c84-968e-64eca20cf7fe]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:27 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 Sep 28 17:18:27 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (d066997d-57d6-4b1a-bc2a-1b142f8e84dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0805687b-d916-43e6-853f-32438feaff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0805687b-d916-43e6-853f-32438feaff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1262660877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e125eeae-dce2-427d-8884-651cf582c28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:27Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b489c83-72af-4a3d-b323-2c7205233091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b489c83-72af-4a3d-b323-2c7205233091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3468ee6-87ae-4beb-b51d-8daa4267d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3468ee6-87ae-4beb-b51d-8daa4267d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e125eeae-dce2-427d-8884-651cf582c28f', 'volume_name': 'volume-e125eeae-dce2-427d-8884-651cf582c28f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48fed81-8f0a-41d3-9eca-a438eb3b85ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48fed81-8f0a-41d3-9eca-a438eb3b85ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20fc1dd-3265-4851-b87a-8c12ecff9bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Volume e125eeae-dce2-427d-8884-651cf582c28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e125eeae-dce2-427d-8884-651cf582c28f', 'volume_size': 1} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1262660877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e125eeae-dce2-427d-8884-651cf582c28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:27Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Creating volume e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:27 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:27 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f 1073741824 Sep 28 17:18:27 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:27 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0" returned: 0 in 0.678s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:27 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0 Sep 28 17:18:27 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:28 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-b96b943d-8686-4a14-bf75-3abdeacb69a0" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-b96b943d-8686-4a14-bf75-3abdeacb69a0" released by "delete_volume" :: held 1.166s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Created reservations ['56b95548-b00e-4b15-9ea7-aa9e27aa92b4', '1794b7de-c39b-4696-b379-5be8ad3a7548', 'b08b1b13-25e6-403c-a7dd-2c58dd042ad2', '487b6972-4d71-44bf-aad7-dd1163761e24'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:28 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f 1073741824" returned: 0 in 0.706s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:28 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:28 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:28 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:28 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.308s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Deleted volume successfully. Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2504fb4d-5b4b-4243-b72c-325c25c40055 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-b96b943d-8686-4a14-bf75-3abdeacb69a0-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:28 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.308s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20fc1dd-3265-4851-b87a-8c12ecff9bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e125eeae-dce2-427d-8884-651cf582c28f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c38e3-5faf-4d39-8986-62c9610159df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:28 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Volume volume-e125eeae-dce2-427d-8884-651cf582c28f (e125eeae-dce2-427d-8884-651cf582c28f): created successfully Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592c38e3-5faf-4d39-8986-62c9610159df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (d066997d-57d6-4b1a-bc2a-1b142f8e84dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-558b31ff-4b2a-4b59-88f4-9e65c2d20a9e tempest-VolumesSnapshotTestJSON-443050478 None] Created volume successfully. Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-5919155c-1085-46e7-8122-5ae9d26d7eda-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-5919155c-1085-46e7-8122-5ae9d26d7eda-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-quobyte-5919155c-1085-46e7-8122-5ae9d26d7eda" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-5919155c-1085-46e7-8122-5ae9d26d7eda" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[86617519-ca9d-4e01-9d29-62fdce687057]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:29 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda Sep 28 17:18:29 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Creating offline snapshot 1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 of volume e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a1b70-c85a-410b-bd02-b685fa00d8fc]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:29 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:29 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda Sep 28 17:18:29 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:29 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:29 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5919155c-1085-46e7-8122-5ae9d26d7eda" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-5919155c-1085-46e7-8122-5ae9d26d7eda" released by "delete_volume" :: held 0.984s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:30 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:30 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.541s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:30 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 1G Sep 28 17:18:30 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Created reservations ['d9c3b647-5dfe-4ff3-84a5-5e9aa3ce3546', '680851a3-7c8a-4b4b-af2e-0a0a07d9d7f9', '30e42b98-29ff-4209-a252-2453a3cf7483', '58f5518d-7630-4e43-ab9b-ff2054fd21a2'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:30 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:30 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:30 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.359s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Deleted volume successfully. Sep 28 17:18:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ea535cd8-8dd5-4e05-a02c-7b00f97f7604 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-5919155c-1085-46e7-8122-5ae9d26d7eda-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:31 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 1G" returned: 0 in 0.679s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e125eeae-dce2-427d-8884-651cf582c28f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:31 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e125eeae-dce2-427d-8884-651cf582c28f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:31 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:31 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e125eeae-dce2-427d-8884-651cf582c28f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:31 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 is being set with open permissions: ugo+rw Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:31 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:31 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-55f3f28c-c357-4ee3-92e8-b8ce139a8b12-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-55f3f28c-c357-4ee3-92e8-b8ce139a8b12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "cinder-quobyte-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:31 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[115630e0-117c-4188-815e-17499e7c94b0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:31 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info Sep 28 17:18:31 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:31 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 Sep 28 17:18:31 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:32 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info" returned: 0 in 0.338s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:32 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info is being set with open permissions: ugo+rw Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:32 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info Sep 28 17:18:32 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:32 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" returned: 0 in 0.586s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:32 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12 Sep 28 17:18:32 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:32 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.info" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-18c00ab0-8708-4d8f-9677-d20f86a8d22e tempest-VolumesSnapshotTestJSON-443050478 None] Create snapshot completed successfully Sep 28 17:18:32 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-quobyte-55f3f28c-c357-4ee3-92e8-b8ce139a8b12" released by "delete_volume" :: held 1.043s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Created reservations ['a294ae0d-acbd-4996-980b-479bca908ced', '2214436b-e27b-41ba-89d1-969422ab5e40', '8b77f87c-7c90-4019-8c87-15eb8fcbdcd0', '93631095-671d-452f-994b-0baddd814098'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:33 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:33 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:33 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Deleted volume successfully. Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3c0260a7-b2b7-4f23-b0a0-ad9c482ae3f7 tempest-VolumesListTestJSON-2059230395 None] Lock "cinder-55f3f28c-c357-4ee3-92e8-b8ce139a8b12-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (6dd7c4d0-9c77-40ba-8db8-6200dd6acfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9716e64-bffa-42f4-8194-f96fb2002370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9716e64-bffa-42f4-8194-f96fb2002370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1625771673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28add764-992f-4740-857b-1335c19940bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:34Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a448be-d305-4258-83bd-87fc1132c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a448be-d305-4258-83bd-87fc1132c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac83fff6-5ca6-4316-9520-4c50788f5876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac83fff6-5ca6-4316-9520-4c50788f5876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28add764-992f-4740-857b-1335c19940bd', 'volume_name': 'volume-28add764-992f-4740-857b-1335c19940bd', 'volume_size': 2, 'snapshot_id': '1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58fd1ed-0c4d-4f67-94ae-ba6cce6b61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58fd1ed-0c4d-4f67-94ae-ba6cce6b61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f34e5-2c60-464a-b1ee-baea05774606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Volume 28add764-992f-4740-857b-1335c19940bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28add764-992f-4740-857b-1335c19940bd', 'volume_size': 2, 'snapshot_id': '1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9'} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-28add764-992f-4740-857b-1335c19940bd" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-28add764-992f-4740-857b-1335c19940bd" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Creating volume 28add764-992f-4740-857b-1335c19940bd from snapshot 1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] snapshot: 1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9, volume: 28add764-992f-4740-857b-1335c19940bd, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e1a304-cbac-41a7-bc87-5e167f66bd96]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:34 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:34 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:34 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.520s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e125eeae-dce2-427d-8884-651cf582c28f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b638bad-c0b2-4f8f-a9e9-d85bcdfd5f06]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:34 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:34 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:35 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.530s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:18:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:18:35 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:18:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:35 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd Sep 28 17:18:35 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=32,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Flow 'volume_create_manager' (5f509275-0bda-4cdd-89bc-d661880cdd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1190997-0e16-45ae-b3ba-c8e9b5db0ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1190997-0e16-45ae-b3ba-c8e9b5db0ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-369843444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa5b5a2c93e46dd8be0957bd22bcb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:44Z,use_quota=True,user_id='578b46feb3d941ec95dea3e4c2fc72f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48f6e2-774e-424f-9fe1-52ceb45b9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae48f6e2-774e-424f-9fe1-52ceb45b9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6929c-27fa-4d24-a044-86ca7e662daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f6929c-27fa-4d24-a044-86ca7e662daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd', 'volume_name': 'volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f520c3e-9177-45d9-88ba-05c8075e0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f520c3e-9177-45d9-88ba-05c8075e0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b064c9-4c3b-4796-a40c-c59dc107f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Volume 24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd', 'volume_size': 1} Sep 28 17:18:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd" returned: 0 in 8.967s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:18:44 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Converted 1024.00 MB image at 114.19 MB/s Sep 28 17:18:44 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd is being set with open permissions: ugo+rw Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd Sep 28 17:18:44 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd" returned: 0 in 0.256s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" released by "_copy_volume_from_snapshot" :: held 10.388s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-28add764-992f-4740-857b-1335c19940bd" released by "_create_volume_from_snapshot" :: held 10.462s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.484s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-369843444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa5b5a2c93e46dd8be0957bd22bcb33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:44Z,use_quota=True,user_id='578b46feb3d941ec95dea3e4c2fc72f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Creating volume 24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:44 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd 1073741824 Sep 28 17:18:44 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f34e5-2c60-464a-b1ee-baea05774606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28add764-992f-4740-857b-1335c19940bd', 'volume_size': 2, 'snapshot_id': '1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06938321-2c63-4f70-a5a4-3813c6c5b0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:44 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Volume volume-28add764-992f-4740-857b-1335c19940bd (28add764-992f-4740-857b-1335c19940bd): created successfully Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06938321-2c63-4f70-a5a4-3813c6c5b0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (6dd7c4d0-9c77-40ba-8db8-6200dd6acfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-03fed749-058e-4304-81d7-954cc7044934 tempest-VolumesSnapshotTestJSON-443050478 None] Created volume successfully. Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:44 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:44 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:44 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.282s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:18:44 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd 1073741824" returned: 0 in 0.607s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd Sep 28 17:18:45 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-28add764-992f-4740-857b-1335c19940bd-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-28add764-992f-4740-857b-1335c19940bd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:45 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" acquired by "delete_volume" :: waited 0.041s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b064c9-4c3b-4796-a40c-c59dc107f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7f80eb-110e-45e2-a7fd-49d2330d726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ac622-dca6-424d-b75f-06af59847262]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Volume volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd (24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd): created successfully Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7f80eb-110e-45e2-a7fd-49d2330d726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Flow 'volume_create_manager' (5f509275-0bda-4cdd-89bc-d661880cdd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f408d669-5a77-452f-87ee-50267147c60a tempest-VolumesNegativeTest-1611372670 None] Created volume successfully. Sep 28 17:18:45 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd Sep 28 17:18:45 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:45 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd" returned: 0 in 0.534s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:45 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd Sep 28 17:18:45 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:46 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-28add764-992f-4740-857b-1335c19940bd" returned: 0 in 0.322s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-28add764-992f-4740-857b-1335c19940bd" released by "delete_volume" :: held 0.936s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['5e4f1cbb-0367-479b-8229-40201e7cd26a', '8f195cd8-0188-4796-9392-4b2cd012a81f', 'd066f671-44b9-4b07-a576-8c887a17c019', '7dcfa9d3-4677-40ec-8062-67b593457335'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:46 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:46 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:46 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.352s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Deleted volume successfully. Sep 28 17:18:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-751ebc07-527f-425c-a2f4-11073f3a29e6 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-28add764-992f-4740-857b-1335c19940bd-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Deleting offline snapshot 1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 of volume e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] snapshot_file for this snap is: volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea604ed-8d9f-4111-9171-c1359d07bfd5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:48 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:48 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:48 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.539s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e125eeae-dce2-427d-8884-651cf582c28f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:18:48 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e4606f-5c00-4897-9206-bd5361e20dcb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:48 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:48 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:49 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.913s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:49 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:49 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:49 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.553s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:49 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9 Sep 28 17:18:49 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:50 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f.1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" returned: 0 in 0.280s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9" released by "_delete_snapshot" :: held 2.471s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" released by "delete_snapshot" :: held 2.502s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:50 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['45b40901-57fb-4f35-af40-414f8843d25a', 'ca007663-4aaf-4429-afc1-873c55d1e880', 'aa6afe20-36be-4f18-aad8-587680c3a43c', 'c04d47fb-e60b-4d46-823f-0966fc6ff045'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Delete snapshot completed successfully. Sep 28 17:18:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b9c33eb3-711b-4dd5-999c-00001bd311aa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-1af02a8d-f9da-4508-9ab5-a3b4b8b5b0f9-delete_snapshot" released by "delete_snapshot" :: held 2.762s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-e125eeae-dce2-427d-8884-651cf582c28f-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e125eeae-dce2-427d-8884-651cf582c28f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd215657-3588-4ec3-ad9b-9acab69f05c1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:51 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:51 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:51 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.552s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:51 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f Sep 28 17:18:51 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:52 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e125eeae-dce2-427d-8884-651cf582c28f" returned: 0 in 0.485s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e125eeae-dce2-427d-8884-651cf582c28f" released by "delete_volume" :: held 1.196s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['8e7f6eab-c650-4620-9297-11c1bd627774', 'dc408e11-7282-48ac-b055-630cc1cf6eb5', '2e4ccc79-d77e-41a5-83c6-b8ffaf59f899', 'bd54469c-0273-4b66-bfc7-86f2ab9e1edd'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:52 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:18:52 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:53 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:53 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:18:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Deleted volume successfully. Sep 28 17:18:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9fca84f9-2c00-4f92-9924-ae082960f9fc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e125eeae-dce2-427d-8884-651cf582c28f-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (cb18522c-e320-4cd4-bb84-42ff779decfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a372c21-73ac-4339-b3cb-ea74d5dc25b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a372c21-73ac-4339-b3cb-ea74d5dc25b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889867216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c839b6fd-3b1d-45d1-b3ce-83877afde06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:55Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fd45b-7958-4366-b9c9-7d0af4b3b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21fd45b-7958-4366-b9c9-7d0af4b3b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136699b9-ecfc-4297-8f24-9774848c16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136699b9-ecfc-4297-8f24-9774848c16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c839b6fd-3b1d-45d1-b3ce-83877afde06e', 'volume_name': 'volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cdf6c2-fbcc-4d16-9df5-8e68fc80e645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cdf6c2-fbcc-4d16-9df5-8e68fc80e645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b932682d-10ce-44be-90ed-50f46108642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:55 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Volume c839b6fd-3b1d-45d1-b3ce-83877afde06e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e', 'volume_size': 1} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1889867216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c839b6fd-3b1d-45d1-b3ce-83877afde06e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:18:55Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Creating volume c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:18:55 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:18:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:55 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e 1073741824 Sep 28 17:18:55 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:56 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e 1073741824" returned: 0 in 0.921s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:56 devstack sudo[101337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:18:56 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:56 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b932682d-10ce-44be-90ed-50f46108642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29f54dc-837e-4a75-ab1f-448385a205f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:18:56 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Volume volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e (c839b6fd-3b1d-45d1-b3ce-83877afde06e): created successfully Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a29f54dc-837e-4a75-ab1f-448385a205f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:18:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (cb18522c-e320-4cd4-bb84-42ff779decfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:18:56 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8baa0d2a-8f50-4ec0-8686-5084aea3affc tempest-VolumesSnapshotTestJSON-443050478 None] Created volume successfully. Sep 28 17:18:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:18:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:18:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Creating offline snapshot 51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 of volume c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:18:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff78589-928b-4748-87a9-8230d99f9ab7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:18:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:57 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:18:57 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:58 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 1.009s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:58 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 1G Sep 28 17:18:58 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:59 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 1G" returned: 0 in 0.818s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:59 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:18:59 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:18:59 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 28 17:18:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.433s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:18:59 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 is being set with open permissions: ugo+rw Sep 28 17:18:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:18:59 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:18:59 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:00 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.366s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:00 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info Sep 28 17:19:00 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:00 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info" returned: 0 in 0.446s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info is being set with open permissions: ugo+rw Sep 28 17:19:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:00 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info Sep 28 17:19:00 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:01 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.info" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.757s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3dd56e93-909e-45fa-820d-ed4b8d583825 tempest-VolumesSnapshotTestJSON-443050478 None] Create snapshot completed successfully Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (f4bae53d-d76f-4410-ab3d-94b313a0a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73d24e5-efb6-459a-8ea2-4f4b38d12908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73d24e5-efb6-459a-8ea2-4f4b38d12908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176621085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e0e768-2690-4d1d-9c7d-a6423edd4eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0534248d1d6044b5b393a2b51c5effc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:03Z,use_quota=True,user_id='76e2f8ea915d42d780ea98876672ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bd09a8-926a-4c7f-8b8e-6d33b65af41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bd09a8-926a-4c7f-8b8e-6d33b65af41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce20473-ed3a-49d5-b4d2-2cd11b7e0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce20473-ed3a-49d5-b4d2-2cd11b7e0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e1e0e768-2690-4d1d-9c7d-a6423edd4eb5', 'volume_name': 'volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5', 'volume_size': 1, 'snapshot_id': '51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171e8b53-fa1c-488f-9022-b00382ecd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171e8b53-fa1c-488f-9022-b00382ecd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d005f1d-b82a-4c26-bfdf-20abd664ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Volume e1e0e768-2690-4d1d-9c7d-a6423edd4eb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5', 'volume_size': 1, 'snapshot_id': '51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6'} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Creating volume e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 from snapshot 51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] snapshot: 51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6, volume: e1e0e768-2690-4d1d-9c7d-a6423edd4eb5, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0691f5-001c-4ad3-b504-899cbf3d4034]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:03 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:19:03 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:03 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.724s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b99dd4e-5f97-410f-997b-4b8f6417391f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:04 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:19:04 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:04 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 0.557s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:19:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:04 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 Sep 28 17:19:04 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=48,cinder:INSERT=15,cinder:UPDATE=54,cinder:DELETE=8 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:13 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" returned: 0 in 9.055s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e, size 1024.00 MB, duration 9.06 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:19:13 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Converted 1024.00 MB image at 113.07 MB/s Sep 28 17:19:13 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 is being set with open permissions: ugo+rw Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:13 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 Sep 28 17:19:13 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:13 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" returned: 0 in 0.284s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" released by "_copy_volume_from_snapshot" :: held 10.812s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" released by "_create_volume_from_snapshot" :: held 10.932s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.955s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d005f1d-b82a-4c26-bfdf-20abd664ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5', 'volume_size': 1, 'snapshot_id': '51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9b2344-2e92-4278-82e8-b97955256a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Volume volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 (e1e0e768-2690-4d1d-9c7d-a6423edd4eb5): created successfully Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da9b2344-2e92-4278-82e8-b97955256a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Flow 'volume_create_manager' (f4bae53d-d76f-4410-ab3d-94b313a0a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:14 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-43f87f5e-3921-4809-9008-aabc32177402 tempest-VolumesSnapshotTestJSON-443050478 None] Created volume successfully. Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8f536-25b6-469e-8c8e-bcec13463b9f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:14 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 Sep 28 17:19:14 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" returned: 0 in 0.508s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5 Sep 28 17:19:15 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5" released by "delete_volume" :: held 0.876s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['03c1daa7-b188-4204-b159-d1d26f7b4414', '8c9f25d4-66a3-4d1e-8fbf-0e066571229d', '1048bbaf-79bd-450b-b202-677aab436c53', 'e24bcbad-7d2a-4701-ae07-16d86e16dd7d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:15 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Deleting offline snapshot 51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 of volume c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] snapshot_file for this snap is: volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e266d-4cbd-4bd9-9cd1-9018344528b9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:15 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Deleted volume successfully. Sep 28 17:19:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ac035765-eebf-417d-886b-a0f6e41966fa tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e1e0e768-2690-4d1d-9c7d-a6423edd4eb5-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:16 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:19:16 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.494s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c531b2e1-5682-48ae-a09d-5024dc804f6a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:16 devstack sudo[101547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:19:16 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Acquiring lock "cinder-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "cinder-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Acquiring lock "cinder-quobyte-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "cinder-quobyte-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:17 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 0.662s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bd555d-d03c-48e7-9053-7d49c65a0b29]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:19:17 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd Sep 28 17:19:17 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.431s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack sudo[101562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6 Sep 28 17:19:17 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" returned: 0 in 0.446s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:17 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd Sep 28 17:19:17 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:17 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e.51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" returned: 0 in 0.266s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6" released by "_delete_snapshot" :: held 2.024s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" released by "delete_snapshot" :: held 2.055s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "cinder-quobyte-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd" released by "delete_volume" :: held 0.844s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['685dec69-0ac3-4ffc-98d4-8d982ed3a1cf', '47779388-55af-4d61-bdf9-61d503fc8a74', 'e66b6a18-ac9e-43f8-8fc7-985ceb9caa3a', 'aefb9143-5991-4571-88dd-93bff2ed3024'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Created reservations ['bc595a32-f35b-4857-aed1-478b52be63ee', '577ced27-f10c-42d3-8af2-eda655d13f7c', 'd95d8c22-a745-41b1-9908-d009c277356a', '58df26e4-1c7a-46ff-a39b-9d686a454c4a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Delete snapshot completed successfully. Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-fcab70a5-3913-4789-b43b-73e461e4ed8f tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-51ed4c4d-18ee-4167-a38a-9a4e89d6bcc6-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:18 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:18 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:18 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Deleted volume successfully. Sep 28 17:19:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d79daf09-8557-428d-ba3a-63e4a5021ad7 tempest-VolumesNegativeTest-1611372670 None] Lock "cinder-24c7e8e9-ff0c-4508-9bdd-4e5812a26ffd-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-c839b6fd-3b1d-45d1-b3ce-83877afde06e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-c839b6fd-3b1d-45d1-b3ce-83877afde06e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a4a85-f506-48c3-8dfd-ebaf4d477a4c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:19:19 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:19 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e Sep 28 17:19:19 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:19 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c839b6fd-3b1d-45d1-b3ce-83877afde06e" returned: 0 in 0.318s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-c839b6fd-3b1d-45d1-b3ce-83877afde06e" released by "delete_volume" :: held 0.848s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['4d94702e-4685-494b-815e-a4a1f48d2666', '64fbaed0-3855-4d33-95b9-9deb5b9d3f79', 'f7a4de0c-1d41-4045-8291-02b440553606', 'f02596e2-f84f-43d2-9a7f-6660c6e61d24'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:20 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-e1593efc-08c7-4ff3-b277-6eec486bbaad-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e1593efc-08c7-4ff3-b277-6eec486bbaad-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:20 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.340s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Deleted volume successfully. Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f1d2cde-5e1a-4f3f-a8dc-95a89007d5d8 tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-c839b6fd-3b1d-45d1-b3ce-83877afde06e-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[942510ec-e3af-4fd5-bd3b-63d3030b29dc]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad Sep 28 17:19:20 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:20 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad" returned: 0 in 0.433s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:20 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad Sep 28 17:19:20 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1593efc-08c7-4ff3-b277-6eec486bbaad" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-quobyte-e1593efc-08c7-4ff3-b277-6eec486bbaad" released by "delete_volume" :: held 0.860s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Created reservations ['76690818-aaea-4350-bb15-777d2d76ec29', 'e5c3661d-d3e7-4ebe-857a-e8412197f7ce', '4423458d-36e6-4e15-85a7-5c3087788027', '4c2d4caa-269d-4243-9e40-c90c8916aa23'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:21 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:21 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:21 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Deleted volume successfully. Sep 28 17:19:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfda3176-8bf0-400e-8159-9f99eb9ecdae tempest-VolumesSnapshotTestJSON-443050478 None] Lock "cinder-e1593efc-08c7-4ff3-b277-6eec486bbaad-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Flow 'volume_create_manager' (d11c656b-9967-4d02-9d81-1baa2ee6db4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991e23ae-59ae-4921-8aa5-244002f25197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991e23ae-59ae-4921-8aa5-244002f25197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1811183571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceece95a-02ec-4d6a-9908-306a30822a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca442f3422ff40fda93442a2bb541cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:29Z,use_quota=True,user_id='05536fed447f43db96073e909ae060a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f3b74d-11d3-4c49-8e17-63a53d08b947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f3b74d-11d3-4c49-8e17-63a53d08b947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a70458-147f-47fe-bb85-7a6ede5bcb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a70458-147f-47fe-bb85-7a6ede5bcb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceece95a-02ec-4d6a-9908-306a30822a73', 'volume_name': 'volume-ceece95a-02ec-4d6a-9908-306a30822a73', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c358f37-e387-4e4d-89ae-ad0fb5b6a593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c358f37-e387-4e4d-89ae-ad0fb5b6a593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154b658b-a471-40b5-859e-6e579f82272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Volume ceece95a-02ec-4d6a-9908-306a30822a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceece95a-02ec-4d6a-9908-306a30822a73', 'volume_size': 1} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1811183571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceece95a-02ec-4d6a-9908-306a30822a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca442f3422ff40fda93442a2bb541cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:29Z,use_quota=True,user_id='05536fed447f43db96073e909ae060a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Creating volume ceece95a-02ec-4d6a-9908-306a30822a73 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:29 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:19:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:29 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 1073741824 Sep 28 17:19:29 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 1073741824" returned: 0 in 0.619s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:30 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 Sep 28 17:19:30 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:30 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73" returned: 0 in 0.414s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154b658b-a471-40b5-859e-6e579f82272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceece95a-02ec-4d6a-9908-306a30822a73', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a12981-0983-48b0-b7e9-df0ad9a80adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Volume volume-ceece95a-02ec-4d6a-9908-306a30822a73 (ceece95a-02ec-4d6a-9908-306a30822a73): created successfully Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a12981-0983-48b0-b7e9-df0ad9a80adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Flow 'volume_create_manager' (d11c656b-9967-4d02-9d81-1baa2ee6db4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c4447f42-f393-4b78-a20d-2a869c3439f6 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Created volume successfully. Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Flow 'volume_create_manager' (94a05f03-801a-4157-8a1a-f36cf2bdfecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29db6cdf-bdde-470e-ad9f-7e58f1fcfdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29db6cdf-bdde-470e-ad9f-7e58f1fcfdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-861018077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a89805-26d6-4a1f-aa78-6d3259ab5972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30821a3d28694416b168fcc4bcffe4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:33Z,use_quota=True,user_id='8254a192e81d4bc190393c97582e7b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565d251-4b55-4c3e-8da3-b69a99526e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5565d251-4b55-4c3e-8da3-b69a99526e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08688fbd-6393-4153-bb09-9be91c91dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08688fbd-6393-4153-bb09-9be91c91dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a89805-26d6-4a1f-aa78-6d3259ab5972', 'volume_name': 'volume-20a89805-26d6-4a1f-aa78-6d3259ab5972', 'volume_size': 2}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87ee68-a4c1-47d4-85c7-6024389e9a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c87ee68-a4c1-47d4-85c7-6024389e9a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37da310-ff9d-4b35-bc99-61da8226142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Volume 20a89805-26d6-4a1f-aa78-6d3259ab5972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a89805-26d6-4a1f-aa78-6d3259ab5972', 'volume_size': 2} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-861018077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20a89805-26d6-4a1f-aa78-6d3259ab5972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30821a3d28694416b168fcc4bcffe4a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:19:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:19:33Z,use_quota=True,user_id='8254a192e81d4bc190393c97582e7b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Creating volume 20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:19:33 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 2147483648 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:33 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 2147483648 Sep 28 17:19:33 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f66eafa4-2dc7-47e7-bd8e-eea5f6beeb35 req-6a07adcb-c15e-44ba-ae87-fcd056d179a2 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:33 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 2147483648" returned: 0 in 0.718s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:34 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 Sep 28 17:19:34 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:34 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972" returned: 0 in 0.343s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f66eafa4-2dc7-47e7-bd8e-eea5f6beeb35 req-6a07adcb-c15e-44ba-ae87-fcd056d179a2 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.053s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37da310-ff9d-4b35-bc99-61da8226142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a89805-26d6-4a1f-aa78-6d3259ab5972', 'volume_size': 2}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529fb4ad-db66-46ce-85cf-1fab56073386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-f66eafa4-2dc7-47e7-bd8e-eea5f6beeb35 req-6a07adcb-c15e-44ba-ae87-fcd056d179a2 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Volume volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 (20a89805-26d6-4a1f-aa78-6d3259ab5972): created successfully Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (529fb4ad-db66-46ce-85cf-1fab56073386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Flow 'volume_create_manager' (94a05f03-801a-4157-8a1a-f36cf2bdfecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:19:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-35562867-b711-4280-8fc6-b974a81319bb tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Created volume successfully. Sep 28 17:19:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-f66eafa4-2dc7-47e7-bd8e-eea5f6beeb35 req-6a07adcb-c15e-44ba-ae87-fcd056d179a2 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-ceece95a-02ec-4d6a-9908-306a30822a73', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62397fd2-5a7d-4452-8cff-a7a92b1f3a7d', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:19:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-f66eafa4-2dc7-47e7-bd8e-eea5f6beeb35 req-6a07adcb-c15e-44ba-ae87-fcd056d179a2 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] attachment_update completed successfully. Sep 28 17:19:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Creating offline snapshot e5fbdfcd-c446-462c-b144-3eb6980ebbba of volume 20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:19:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca533e07-5b0d-4cda-bf9c-e4f7a25d4eb1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:35 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 Sep 28 17:19:35 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972" returned: 0 in 0.513s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba 2G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:36 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba 2G Sep 28 17:19:36 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:36 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba 2G" returned: 0 in 0.616s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:36 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba Sep 28 17:19:36 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba is being set with open permissions: ugo+rw Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba Sep 28 17:19:37 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba" returned: 0 in 0.329s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info Sep 28 17:19:37 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:37 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info" returned: 0 in 0.303s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:37 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info is being set with open permissions: ugo+rw Sep 28 17:19:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:37 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info Sep 28 17:19:37 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-fced54c1-bdad-487b-afb4-7bdb2a3849b4 req-9d7635dd-1579-4fb3-b71d-2f61e4c34755 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Terminate volume connection completed successfully. Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-fced54c1-bdad-487b-afb4-7bdb2a3849b4 req-9d7635dd-1579-4fb3-b71d-2f61e4c34755 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Deleting attachment 62397fd2-5a7d-4452-8cff-a7a92b1f3a7d. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:19:38 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.info" returned: 0 in 0.361s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.714s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-faae5454-28ee-49f9-948f-a1c6a32f8f41 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Create snapshot completed successfully Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "cinder-ceece95a-02ec-4d6a-9908-306a30822a73-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "cinder-e5fbdfcd-c446-462c-b144-3eb6980ebbba-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-e5fbdfcd-c446-462c-b144-3eb6980ebbba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "cinder-ceece95a-02ec-4d6a-9908-306a30822a73-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "cinder-quobyte-e5fbdfcd-c446-462c-b144-3eb6980ebbba" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-e5fbdfcd-c446-462c-b144-3eb6980ebbba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Deleting offline snapshot e5fbdfcd-c446-462c-b144-3eb6980ebbba of volume 20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] snapshot_file for this snap is: volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "cinder-quobyte-ceece95a-02ec-4d6a-9908-306a30822a73" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d392f9e9-8576-4027-8f4b-8e52ea499d11]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "cinder-quobyte-ceece95a-02ec-4d6a-9908-306a30822a73" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde5a31-cd0e-4221-872b-a2c69e6db730]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba Sep 28 17:19:39 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 Sep 28 17:19:39 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a89805-26d6-4a1f-aa78-6d3259ab5972(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:19:39 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73" returned: 0 in 0.522s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0340573e-ced5-4428-bcd2-674f5e4e1e6c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:39 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73 Sep 28 17:19:39 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 Sep 28 17:19:39 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:39 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ceece95a-02ec-4d6a-9908-306a30822a73" returned: 0 in 0.324s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "cinder-quobyte-ceece95a-02ec-4d6a-9908-306a30822a73" released by "delete_volume" :: held 0.910s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Created reservations ['e43e6e89-8c62-44c5-b1c7-a1ddef0dbe18', 'a257bfd9-1ac9-4692-9c83-29656a0fa183', '817851c9-75aa-4e9f-8788-f07f11bce22b', '7ea2920f-d82e-4d08-ad57-29fbebc4b70b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:40 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972" returned: 0 in 0.552s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:40 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba Sep 28 17:19:40 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Deleted volume successfully. Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f2796a2f-2882-48a8-8f75-0f57fd875ae8 tempest-TestServerVolumeAttachScenarioOldVersion-1831417371 None] Lock "cinder-ceece95a-02ec-4d6a-9908-306a30822a73-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba" returned: 0 in 0.406s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:40 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba Sep 28 17:19:40 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:40 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972.e5fbdfcd-c446-462c-b144-3eb6980ebbba" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-e5fbdfcd-c446-462c-b144-3eb6980ebbba" released by "_delete_snapshot" :: held 1.945s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" released by "delete_snapshot" :: held 1.973s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:40 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Created reservations ['dcc77d4e-851e-423b-b8b0-5b4a30c18d04', 'c8cdc9e6-fc07-4412-8bc7-730302288ec8', '2bb4ec1c-7fd4-4590-a304-ec8cf11ef419', '058b653b-b487-4e72-a9bd-50d34b6f826b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Delete snapshot completed successfully. Sep 28 17:19:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-392ccb51-2e96-4a07-8242-bbde1b077ff6 tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-e5fbdfcd-c446-462c-b144-3eb6980ebbba-delete_snapshot" released by "delete_snapshot" :: held 2.316s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "cinder-20a89805-26d6-4a1f-aa78-6d3259ab5972-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-20a89805-26d6-4a1f-aa78-6d3259ab5972-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce951087-6f67-4185-97b8-2534c80bbd6b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:19:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:42 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 Sep 28 17:19:42 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972" returned: 0 in 0.594s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:43 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972 Sep 28 17:19:43 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-20a89805-26d6-4a1f-aa78-6d3259ab5972" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-quobyte-20a89805-26d6-4a1f-aa78-6d3259ab5972" released by "delete_volume" :: held 1.064s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Created reservations ['7cf64672-32f6-48ee-8117-4b88b46003fd', '2c9a46bc-f6e3-457c-b055-fc09330288e8', '043c2678-b667-49d8-9b6c-8e73a41621f3', '5e93c412-c872-4380-9a82-879d5990af71'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:43 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:43 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:43 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.298s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:43 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Deleted volume successfully. Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2517aa4d-816d-4bb9-b7c6-9ec2508a96ed tempest-VolumesSnapshotNegativeTestJSON-1295981158 None] Lock "cinder-20a89805-26d6-4a1f-aa78-6d3259ab5972-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:19:44 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:19:44 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:19:44 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:19:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:19:53 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=69,cinder:SELECT=56,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:19:53 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=59,cinder:UPDATE=72,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Flow 'volume_create_manager' (ebed185d-479b-4fe7-a58b-b17f6fe7aad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b04bc74-f5bb-45da-9ceb-0ca5a064d37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b04bc74-f5bb-45da-9ceb-0ca5a064d37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-478271180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c722f5d-60b6-4f76-bbf7-a38b895f083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0ca83fef15488a8132412cfd2b634f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:25Z,use_quota=True,user_id='b9c3ec7aa25847aa8dbd2494928cfaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ca314e-1deb-4a82-a913-455d51a25cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36ca314e-1deb-4a82-a913-455d51a25cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947081e6-df09-411e-83ee-3a9769eed092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947081e6-df09-411e-83ee-3a9769eed092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c722f5d-60b6-4f76-bbf7-a38b895f083d', 'volume_name': 'volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8610f62b-53e4-4b34-a863-e435c9206765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8610f62b-53e4-4b34-a863-e435c9206765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9762e7-15c6-4dfd-9fc5-9e15df27411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:25 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Volume 9c722f5d-60b6-4f76-bbf7-a38b895f083d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d', 'volume_size': 1} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-478271180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c722f5d-60b6-4f76-bbf7-a38b895f083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a0ca83fef15488a8132412cfd2b634f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:25Z,use_quota=True,user_id='b9c3ec7aa25847aa8dbd2494928cfaeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Creating volume 9c722f5d-60b6-4f76-bbf7-a38b895f083d {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:25 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:20:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:25 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d 1073741824 Sep 28 17:20:25 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d 1073741824" returned: 0 in 0.620s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:26 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d Sep 28 17:20:26 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:26 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9762e7-15c6-4dfd-9fc5-9e15df27411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2733fb2b-7977-4064-8c54-b2c980c21a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Volume volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d (9c722f5d-60b6-4f76-bbf7-a38b895f083d): created successfully Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2733fb2b-7977-4064-8c54-b2c980c21a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Flow 'volume_create_manager' (ebed185d-479b-4fe7-a58b-b17f6fe7aad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8cd7e00d-92d0-4f24-a2be-1e01b2353cb7 tempest-TestMinimumBasicScenario-801849603 None] Created volume successfully. Sep 28 17:20:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-db33794c-dcb6-499a-a3ab-9ca4e5951ea7 req-d6268d44-5aed-4685-b234-11073f83bc3a tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-db33794c-dcb6-499a-a3ab-9ca4e5951ea7 req-d6268d44-5aed-4685-b234-11073f83bc3a tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-db33794c-dcb6-499a-a3ab-9ca4e5951ea7 req-d6268d44-5aed-4685-b234-11073f83bc3a tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-db33794c-dcb6-499a-a3ab-9ca4e5951ea7 req-d6268d44-5aed-4685-b234-11073f83bc3a tempest-TestMinimumBasicScenario-801849603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8489d059-8203-4901-87b2-bf897da0e564', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:20:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-db33794c-dcb6-499a-a3ab-9ca4e5951ea7 req-d6268d44-5aed-4685-b234-11073f83bc3a tempest-TestMinimumBasicScenario-801849603 None] attachment_update completed successfully. Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Flow 'volume_create_manager' (ba06ca0c-dec6-4b60-bfe6-0ff016d612eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888fa3d-3df0-4dc4-b58d-02ff4bcaa939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2888fa3d-3df0-4dc4-b58d-02ff4bcaa939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1853663034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c695dff-bc2b-4d2c-b619-983c16527576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4551ac9bb4bb9a6f8ee7194337c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:29Z,use_quota=True,user_id='93c75752985e4331911b3e2b2f3f7c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5694ac2f-0848-4e6b-a3ec-86ab9611067d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5694ac2f-0848-4e6b-a3ec-86ab9611067d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b1ce5-8d1e-44ca-8bee-ea483253b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b1ce5-8d1e-44ca-8bee-ea483253b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c695dff-bc2b-4d2c-b619-983c16527576', 'volume_name': 'volume-9c695dff-bc2b-4d2c-b619-983c16527576', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed27e1e2-a1d2-419e-ba95-075927072ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed27e1e2-a1d2-419e-ba95-075927072ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5657871a-c586-44ea-961d-26a596466ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Volume 9c695dff-bc2b-4d2c-b619-983c16527576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c695dff-bc2b-4d2c-b619-983c16527576', 'volume_size': 1} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1853663034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c695dff-bc2b-4d2c-b619-983c16527576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4551ac9bb4bb9a6f8ee7194337c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:29Z,use_quota=True,user_id='93c75752985e4331911b3e2b2f3f7c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Creating volume 9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:29 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:20:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:29 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 1073741824 Sep 28 17:20:29 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:30 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 1073741824" returned: 0 in 0.751s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:30 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:20:30 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:30 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.434s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5657871a-c586-44ea-961d-26a596466ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c695dff-bc2b-4d2c-b619-983c16527576', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9250ba11-e2f4-438e-8af2-36930d54adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Volume volume-9c695dff-bc2b-4d2c-b619-983c16527576 (9c695dff-bc2b-4d2c-b619-983c16527576): created successfully Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9250ba11-e2f4-438e-8af2-36930d54adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Flow 'volume_create_manager' (ba06ca0c-dec6-4b60-bfe6-0ff016d612eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d6d9d178-f133-4ba1-acf6-477649ad1409 tempest-TestStampPattern-1085590122 None] Created volume successfully. Sep 28 17:20:40 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:44 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:20:44 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:44 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.456s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:20:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:20:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:20:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Flow 'volume_create_manager' (dcb83b41-259e-455a-891e-35da96983f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36b139c-c63e-4139-aa8d-29cbe15ccf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a36b139c-c63e-4139-aa8d-29cbe15ccf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968290978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343c7aaa3995468297249afe3a10a673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='434ff0d733c74a1ea7c516da3eb2dbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fbc17c-9120-4626-a433-f7ef39852b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49fbc17c-9120-4626-a433-f7ef39852b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22e5be-907c-4ec1-a3bf-991a651b960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:53 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc22e5be-907c-4ec1-a3bf-991a651b960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'volume_name': 'volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d797ec-dce8-4bd4-8b5b-521034d80630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42d797ec-dce8-4bd4-8b5b-521034d80630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334a57a-66c2-4625-ae21-22e7f8a9b87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:20:54 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Trying to clone bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de at location (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:20:54 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Image download 20.69 MB at 20.69 MB/s Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8909c23-9700-4bfa-aeed-ba9cc9a96988]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:54 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD Sep 28 17:20:54 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD" returned: 0 in 0.421s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de is fetched for user 434ff0d733c74a1ea7c516da3eb2dbab. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed6b63f-a7f9-4dc8-82ca-d2c14a08ee1c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD Sep 28 17:20:55 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:55 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-968290978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='343c7aaa3995468297249afe3a10a673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:20:53Z,use_quota=True,user_id='434ff0d733c74a1ea7c516da3eb2dbab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Creating volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:20:55 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:20:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:55 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1073741824 Sep 28 17:20:55 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1073741824" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 Sep 28 17:20:56 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:56 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" returned: 0 in 0.429s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Attempting download of 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2eb8a1-4ff2-4693-843a-b28fd3d13835]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:56 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d Sep 28 17:20:56 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d" returned: 0 in 0.479s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:57 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d Sep 28 17:20:57 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d" returned: 1 in 0.391s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40f838d7-edca-40ca-9cfd-7bbe1f3736de_k4c21u7d' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cb9b59-0154-4c1b-8a5d-10c135612613]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:57 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD Sep 28 17:20:57 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:20:57 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] 40f838d7-edca-40ca-9cfd-7bbe1f3736de was qcow2, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:20:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:20:57 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 Sep 28 17:20:57 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:00 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" returned: 0 in 2.179s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40f838d7-edca-40ca-9cfd-7bbe1f3736de_ahp7_ycrdevstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:00 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Converted 112.00 MB image at 51.36 MB/s Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:00 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1G Sep 28 17:21:00 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:00 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 1G" returned: 0 in 0.413s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Downloaded image 40f838d7-edca-40ca-9cfd-7bbe1f3736de ((None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}])) to volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Temporary image 40f838d7-edca-40ca-9cfd-7bbe1f3736de for user 434ff0d733c74a1ea7c516da3eb2dbab is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Marking volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Copying metadata from image 40f838d7-edca-40ca-9cfd-7bbe1f3736de to bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Creating volume glance metadata for volume bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 backed by image 40f838d7-edca-40ca-9cfd-7bbe1f3736de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f334a57a-66c2-4625-ae21-22e7f8a9b87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'volume_size': 1, 'image_id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec25418aaca74ed0bae9fc919edfbae8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '40f838d7-edca-40ca-9cfd-7bbe1f3736de', 'created_at': datetime.datetime(2026, 9, 28, 14, 55, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40f838d7-edca-40ca-9cfd-7bbe1f3736de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf36cbc2-a462-43e9-b36b-5ed2f2b9287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:00 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Volume volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 (bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93): created successfully Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf36cbc2-a462-43e9-b36b-5ed2f2b9287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Flow 'volume_create_manager' (dcb83b41-259e-455a-891e-35da96983f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e2ddd196-51fd-4787-8aec-3d41b56b9dce tempest-TestShelveInstance-1077567384 None] Created volume successfully. Sep 28 17:21:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ab1d057-c13c-4fb1-a277-74c266d198b9 req-10c6eebf-3ee2-48cc-bfa0-1ff3e6b0a8a0 tempest-TestShelveInstance-1077567384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ab1d057-c13c-4fb1-a277-74c266d198b9 req-10c6eebf-3ee2-48cc-bfa0-1ff3e6b0a8a0 tempest-TestShelveInstance-1077567384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ab1d057-c13c-4fb1-a277-74c266d198b9 req-10c6eebf-3ee2-48cc-bfa0-1ff3e6b0a8a0 tempest-TestShelveInstance-1077567384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-6ab1d057-c13c-4fb1-a277-74c266d198b9 req-10c6eebf-3ee2-48cc-bfa0-1ff3e6b0a8a0 tempest-TestShelveInstance-1077567384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '605ec4b2-3d01-4c8d-aa0a-3fd796d683fd', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-6ab1d057-c13c-4fb1-a277-74c266d198b9 req-10c6eebf-3ee2-48cc-bfa0-1ff3e6b0a8a0 tempest-TestShelveInstance-1077567384 None] attachment_update completed successfully. Sep 28 17:21:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ad18a976-6c83-4f59-8eb6-30b517a38f83 req-e356555e-6464-405e-93ca-74a71c7d0f3d tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ad18a976-6c83-4f59-8eb6-30b517a38f83 req-e356555e-6464-405e-93ca-74a71c7d0f3d tempest-TestStampPattern-1085590122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-ad18a976-6c83-4f59-8eb6-30b517a38f83 req-e356555e-6464-405e-93ca-74a71c7d0f3d tempest-TestStampPattern-1085590122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ad18a976-6c83-4f59-8eb6-30b517a38f83 req-e356555e-6464-405e-93ca-74a71c7d0f3d tempest-TestStampPattern-1085590122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-9c695dff-bc2b-4d2c-b619-983c16527576', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36e16498-5230-471b-8045-b0a3b7b64915', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:21:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-ad18a976-6c83-4f59-8eb6-30b517a38f83 req-e356555e-6464-405e-93ca-74a71c7d0f3d tempest-TestStampPattern-1085590122 None] attachment_update completed successfully. Sep 28 17:21:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-27686a92-bdd2-413d-9f46-2c76d8629804 req-e0c7fb79-687a-49d0-9cf6-813570ee8087 tempest-TestStampPattern-1085590122 None] Terminate volume connection completed successfully. Sep 28 17:21:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-27686a92-bdd2-413d-9f46-2c76d8629804 req-e0c7fb79-687a-49d0-9cf6-813570ee8087 tempest-TestStampPattern-1085590122 None] Deleting attachment 36e16498-5230-471b-8045-b0a3b7b64915. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Creating offline snapshot a2960997-67fa-4ffd-ad6d-6cb69ce2523d of volume 9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f54f43a-7ba2-4583-a6bf-6fdbf352f4b6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:20 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:21:20 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:20 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:20 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d 1G Sep 28 17:21:20 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:21 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d 1G" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c695dff-bc2b-4d2c-b619-983c16527576 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c695dff-bc2b-4d2c-b619-983c16527576 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:21:21 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:21 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c695dff-bc2b-4d2c-b619-983c16527576 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.393s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:21 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d is being set with open permissions: ugo+rw Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:21:21 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:21 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.249s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:21 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info Sep 28 17:21:21 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info" returned: 0 in 0.256s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info is being set with open permissions: ugo+rw Sep 28 17:21:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:22 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info Sep 28 17:21:22 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:22 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.info" returned: 0 in 0.251s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-82829192-18b0-4bc8-9766-d918a08eff10 tempest-TestStampPattern-1085590122 None] Create snapshot completed successfully Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Flow 'volume_create_manager' (aea40518-5c50-4593-9921-c17692a44676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7a5ae5-51b2-4947-a4b5-81e7d825ba6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7a5ae5-51b2-4947-a4b5-81e7d825ba6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2141001677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1e4551ac9bb4bb9a6f8ee7194337c06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a2960997-67fa-4ffd-ad6d-6cb69ce2523d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:21:31Z,use_quota=True,user_id='93c75752985e4331911b3e2b2f3f7c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de822e57-024f-4111-a506-d2accd1ecd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de822e57-024f-4111-a506-d2accd1ecd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb78c1a-9a17-41c2-b6a7-4421a023e0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb78c1a-9a17-41c2-b6a7-4421a023e0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317', 'volume_name': 'volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317', 'volume_size': 1, 'snapshot_id': 'a2960997-67fa-4ffd-ad6d-6cb69ce2523d'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19946bfd-85f3-4e78-91c3-614bb455cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19946bfd-85f3-4e78-91c3-614bb455cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a70e2-d30e-47e5-9caa-83fdfd67e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Volume aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317', 'volume_size': 1, 'snapshot_id': 'a2960997-67fa-4ffd-ad6d-6cb69ce2523d'} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Creating volume aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 from snapshot a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] snapshot: a2960997-67fa-4ffd-ad6d-6cb69ce2523d, volume: aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a823585-5714-491a-ae34-04c30f03ecfa]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:31 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:21:31 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.420s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c695dff-bc2b-4d2c-b619-983c16527576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0d31e-55fb-400a-844a-6f8b25ae5583]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:21:32 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:32 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.473s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:21:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:32 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 Sep 28 17:21:32 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:41 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=28,cinder:INSERT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:41 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=14,cinder:SELECT=30,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:21:42 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" returned: 0 in 10.043s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:42 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576, size 1024.00 MB, duration 10.04 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:21:42 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Converted 1024.00 MB image at 101.95 MB/s Sep 28 17:21:42 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 is being set with open permissions: ugo+rw Sep 28 17:21:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:42 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 Sep 28 17:21:42 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:43 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" returned: 0 in 0.436s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" released by "_copy_volume_from_snapshot" :: held 11.486s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" released by "_create_volume_from_snapshot" :: held 11.597s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.626s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a70e2-d30e-47e5-9caa-83fdfd67e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317', 'volume_size': 1, 'snapshot_id': 'a2960997-67fa-4ffd-ad6d-6cb69ce2523d'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9530c5-f808-4237-a1f5-69b04bbb4bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:21:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Volume volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 (aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317): created successfully Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9530c5-f808-4237-a1f5-69b04bbb4bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:21:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Flow 'volume_create_manager' (aea40518-5c50-4593-9921-c17692a44676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:21:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0e5407cf-2af6-4b4a-8231-806e10ae245b tempest-TestStampPattern-1085590122 None] Created volume successfully. Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:44 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:21:44 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:44 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.317s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:21:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:21:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-a0916f18-4eb0-48c5-80cc-b047d26e7b44 req-a720cc07-c6ec-4658-8e15-59afba6c6e6e tempest-TestMinimumBasicScenario-801849603 None] Terminate volume connection completed successfully. Sep 28 17:21:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-a0916f18-4eb0-48c5-80cc-b047d26e7b44 req-a720cc07-c6ec-4658-8e15-59afba6c6e6e tempest-TestMinimumBasicScenario-801849603 None] Deleting attachment 8489d059-8203-4901-87b2-bf897da0e564. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "cinder-9c722f5d-60b6-4f76-bbf7-a38b895f083d-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "cinder-9c722f5d-60b6-4f76-bbf7-a38b895f083d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "cinder-quobyte-9c722f5d-60b6-4f76-bbf7-a38b895f083d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "cinder-quobyte-9c722f5d-60b6-4f76-bbf7-a38b895f083d" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956c7a5-6267-4b0e-ac10-16d38911ec47]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:21:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:47 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d Sep 28 17:21:47 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d" returned: 0 in 0.461s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:48 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d Sep 28 17:21:48 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:48 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c722f5d-60b6-4f76-bbf7-a38b895f083d" returned: 0 in 0.308s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "cinder-quobyte-9c722f5d-60b6-4f76-bbf7-a38b895f083d" released by "delete_volume" :: held 0.838s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Created reservations ['fabcfd5a-817e-4cd1-8f81-955653bd98e4', '2453ef59-f9da-4b00-a61e-41f1204afe73', '5c12b8fc-955f-4778-b4b5-b979152a38d5', '296df340-791d-43e8-940f-929887239003'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:21:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:21:48 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:21:48 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:21:49 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Sep 28 17:21:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.397s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:21:49 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:21:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Deleted volume successfully. Sep 28 17:21:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-70cea702-a5f2-451a-a9aa-95df850b418c tempest-TestMinimumBasicScenario-801849603 None] Lock "cinder-9c722f5d-60b6-4f76-bbf7-a38b895f083d-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:21:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-5879e12a-bd73-4507-af73-7c1009aca18a req-1a59eb34-daab-408a-8582-185a5fe7eae0 tempest-TestShelveInstance-1077567384 None] Terminate volume connection completed successfully. Sep 28 17:21:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-5879e12a-bd73-4507-af73-7c1009aca18a req-1a59eb34-daab-408a-8582-185a5fe7eae0 tempest-TestShelveInstance-1077567384 None] Deleting attachment 605ec4b2-3d01-4c8d-aa0a-3fd796d683fd. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:21:59 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=2,cinder:SELECT=6 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-40e074d6-0548-4dc3-bcaa-1ecc1d2a9910 req-fd8fd1a6-5069-469b-847a-f46a41b93c8d tempest-TestShelveInstance-1077567384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-40e074d6-0548-4dc3-bcaa-1ecc1d2a9910 req-fd8fd1a6-5069-469b-847a-f46a41b93c8d tempest-TestShelveInstance-1077567384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-40e074d6-0548-4dc3-bcaa-1ecc1d2a9910 req-fd8fd1a6-5069-469b-847a-f46a41b93c8d tempest-TestShelveInstance-1077567384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-40e074d6-0548-4dc3-bcaa-1ecc1d2a9910 req-fd8fd1a6-5069-469b-847a-f46a41b93c8d tempest-TestShelveInstance-1077567384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f5f703-cd6c-4a0d-be91-aa3ca2c84da3', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:22:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-40e074d6-0548-4dc3-bcaa-1ecc1d2a9910 req-fd8fd1a6-5069-469b-847a-f46a41b93c8d tempest-TestShelveInstance-1077567384 None] attachment_update completed successfully. Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (289c2411-c3c5-48a3-9b55-301d48610de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eeb765-09fa-429e-864a-2f4909c56a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3eeb765-09fa-429e-864a-2f4909c56a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782658003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c4653e-f9a8-4c03-96b9-57483d692287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:09Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4f653-c416-4e04-8483-d2c036030f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4f653-c416-4e04-8483-d2c036030f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c88ad27-c10c-4b4c-a055-38ef57b8f640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c88ad27-c10c-4b4c-a055-38ef57b8f640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c4653e-f9a8-4c03-96b9-57483d692287', 'volume_name': 'volume-47c4653e-f9a8-4c03-96b9-57483d692287', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb3fe4c-804e-4e07-8e14-c5b5c93d4ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb3fe4c-804e-4e07-8e14-c5b5c93d4ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc8444a-ad09-40b0-832d-d4c4d8bfbb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:09 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Volume 47c4653e-f9a8-4c03-96b9-57483d692287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c4653e-f9a8-4c03-96b9-57483d692287', 'volume_size': 1} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1782658003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c4653e-f9a8-4c03-96b9-57483d692287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:09Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Creating volume 47c4653e-f9a8-4c03-96b9-57483d692287 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:09 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:09 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 1073741824 Sep 28 17:22:09 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (6924f5f2-9e70-4fb2-b0da-98ab5ce19078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce37333-4d57-48a1-9266-27eaa8509035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce37333-4d57-48a1-9266-27eaa8509035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593076440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acaa5f1-5fa1-458f-b65c-13d96203e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:10Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730d18f7-a6c1-46e1-a7a6-e9e722f8c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (730d18f7-a6c1-46e1-a7a6-e9e722f8c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241766cf-d1af-4ae7-a779-04fdbdca0b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (241766cf-d1af-4ae7-a779-04fdbdca0b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9acaa5f1-5fa1-458f-b65c-13d96203e3ac', 'volume_name': 'volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ac0baa-0d16-4d8e-a081-839253e07fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ac0baa-0d16-4d8e-a081-839253e07fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab7f69-85ff-4890-af12-11e0f3384c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Volume 9acaa5f1-5fa1-458f-b65c-13d96203e3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac', 'volume_size': 1} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:10 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 1073741824" returned: 0 in 0.870s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 Sep 28 17:22:10 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287" returned: 0 in 0.464s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1593076440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9acaa5f1-5fa1-458f-b65c-13d96203e3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:10Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Creating volume 9acaa5f1-5fa1-458f-b65c-13d96203e3ac {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:10 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:10 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac 1073741824 Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fc8444a-ad09-40b0-832d-d4c4d8bfbb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c4653e-f9a8-4c03-96b9-57483d692287', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:10 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e53f6a-defc-4e83-83b7-ede9b31f095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (9b1d9e36-faa6-47c3-865f-3b2145367908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b990ac30-6c46-43c7-bff0-17ce33f43335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Volume volume-47c4653e-f9a8-4c03-96b9-57483d692287 (47c4653e-f9a8-4c03-96b9-57483d692287): created successfully Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e53f6a-defc-4e83-83b7-ede9b31f095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (289c2411-c3c5-48a3-9b55-301d48610de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b990ac30-6c46-43c7-bff0-17ce33f43335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754828215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c071335-799b-4082-ac2a-63f9da692df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:11Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19290a1-0a8c-4bd7-b805-a8dd7e9872ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19290a1-0a8c-4bd7-b805-a8dd7e9872ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997828ad-bd39-41a7-bef7-b791af4d61fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997828ad-bd39-41a7-bef7-b791af4d61fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c071335-799b-4082-ac2a-63f9da692df3', 'volume_name': 'volume-8c071335-799b-4082-ac2a-63f9da692df3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb0b5de-0fd4-4e65-8341-55c8ae2f1915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcb0b5de-0fd4-4e65-8341-55c8ae2f1915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7841f33b-2b91-411a-9b52-4d4028ad8627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Volume 8c071335-799b-4082-ac2a-63f9da692df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c071335-799b-4082-ac2a-63f9da692df3', 'volume_size': 1} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1d8f6502-7e5f-400e-9994-a85a1608895d tempest-CreateVolumesFromImageTest-113518560 None] Created volume successfully. Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (bdb682af-2337-4fdc-b67d-3a67f5cba1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262b78f5-763c-428e-8084-0e461d62995a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262b78f5-763c-428e-8084-0e461d62995a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438073166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d935d0c7-84a7-4543-ac8b-2cd26ebee544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:12Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec65ea0-87f4-400c-b806-c7ba7ab20b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec65ea0-87f4-400c-b806-c7ba7ab20b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaa9698-eb21-4150-8932-b3687be3ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaa9698-eb21-4150-8932-b3687be3ce51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd935d0c7-84a7-4543-ac8b-2cd26ebee544', 'volume_name': 'volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a4d81c-900c-41af-ad38-88e9c03d02ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a4d81c-900c-41af-ad38-88e9c03d02ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3705ed88-3253-47ae-9ba4-8523b81bed1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Volume d935d0c7-84a7-4543-ac8b-2cd26ebee544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544', 'volume_size': 1} Sep 28 17:22:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:12 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac 1073741824" returned: 0 in 1.156s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac Sep 28 17:22:12 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (fea6fc4a-5cc7-4c4d-bb8e-232fe00b7708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19c53ae-283a-4dae-89f3-d620126236bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a19c53ae-283a-4dae-89f3-d620126236bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351984595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84622daa-a84b-484a-91b3-66ccf6fca846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:13Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f81978f-4f3d-4385-aacc-b50e85f5b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f81978f-4f3d-4385-aacc-b50e85f5b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f80b649-6b6f-4fa6-b56b-c592185e5426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f80b649-6b6f-4fa6-b56b-c592185e5426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84622daa-a84b-484a-91b3-66ccf6fca846', 'volume_name': 'volume-84622daa-a84b-484a-91b3-66ccf6fca846', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065a0496-d01a-4730-a084-10600b15166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (065a0496-d01a-4730-a084-10600b15166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e37fbe7-793f-48b7-8ee3-e9078df221ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:12 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Volume 84622daa-a84b-484a-91b3-66ccf6fca846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84622daa-a84b-484a-91b3-66ccf6fca846', 'volume_size': 1} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:12 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" returned: 0 in 0.698s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754828215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c071335-799b-4082-ac2a-63f9da692df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:11Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Creating volume 8c071335-799b-4082-ac2a-63f9da692df3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:12 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:12 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 1073741824 Sep 28 17:22:12 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fab7f69-85ff-4890-af12-11e0f3384c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:12 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74bbf76-d968-4962-a03f-9a06d73114cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:13 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Volume volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac (9acaa5f1-5fa1-458f-b65c-13d96203e3ac): created successfully Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f74bbf76-d968-4962-a03f-9a06d73114cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (6924f5f2-9e70-4fb2-b0da-98ab5ce19078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7c01a5e3-af72-4c80-a523-ba47518f541f tempest-CreateVolumesFromImageTest-113518560 None] Created volume successfully. Sep 28 17:22:13 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 1073741824" returned: 0 in 0.546s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:13 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 Sep 28 17:22:13 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3" returned: 0 in 0.307s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.846s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438073166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d935d0c7-84a7-4543-ac8b-2cd26ebee544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:12Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Creating volume d935d0c7-84a7-4543-ac8b-2cd26ebee544 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:13 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:13 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 1073741824 Sep 28 17:22:13 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7841f33b-2b91-411a-9b52-4d4028ad8627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c071335-799b-4082-ac2a-63f9da692df3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc754ce4-3d71-47fc-9acd-2a7adb6802e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:13 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Volume volume-8c071335-799b-4082-ac2a-63f9da692df3 (8c071335-799b-4082-ac2a-63f9da692df3): created successfully Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc754ce4-3d71-47fc-9acd-2a7adb6802e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:13 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (9b1d9e36-faa6-47c3-865f-3b2145367908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-584378d1-8ba1-4f55-9601-f7c1f5141cf3 tempest-CreateVolumesFromImageTest-113518560 None] Created volume successfully. Sep 28 17:22:14 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 1073741824" returned: 0 in 0.555s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:14 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 Sep 28 17:22:14 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:14 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544" returned: 0 in 0.355s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351984595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84622daa-a84b-484a-91b3-66ccf6fca846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6f9049443b54107915cb5630bcbef94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:22:13Z,use_quota=True,user_id='7e194aac85074aa3b201fcc5c59f8a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Creating volume 84622daa-a84b-484a-91b3-66ccf6fca846 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:22:14 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:14 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 1073741824 Sep 28 17:22:14 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3705ed88-3253-47ae-9ba4-8523b81bed1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8e66a1-2b10-4bb6-8f2c-507bac14fd1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Volume volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 (d935d0c7-84a7-4543-ac8b-2cd26ebee544): created successfully Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8e66a1-2b10-4bb6-8f2c-507bac14fd1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (bdb682af-2337-4fdc-b67d-3a67f5cba1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:14 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c8bc67f0-59b8-4de9-9d2b-7078027caa86 tempest-CreateVolumesFromImageTest-113518560 None] Created volume successfully. Sep 28 17:22:15 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 1073741824" returned: 0 in 0.522s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:15 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 Sep 28 17:22:15 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:15 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846" returned: 0 in 0.290s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e37fbe7-793f-48b7-8ee3-e9078df221ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84622daa-a84b-484a-91b3-66ccf6fca846', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4070f81c-9490-49e1-9d6d-a4efa3881dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:22:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Volume volume-84622daa-a84b-484a-91b3-66ccf6fca846 (84622daa-a84b-484a-91b3-66ccf6fca846): created successfully Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4070f81c-9490-49e1-9d6d-a4efa3881dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:22:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Flow 'volume_create_manager' (fea6fc4a-5cc7-4c4d-bb8e-232fe00b7708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:22:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-48f49b74-aa34-40ec-9ed5-4d08fea268db tempest-CreateVolumesFromImageTest-113518560 None] Created volume successfully. Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-84622daa-a84b-484a-91b3-66ccf6fca846-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-84622daa-a84b-484a-91b3-66ccf6fca846-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-quobyte-84622daa-a84b-484a-91b3-66ccf6fca846" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-84622daa-a84b-484a-91b3-66ccf6fca846" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d2d391-1d50-48a1-b161-46f59a434de4]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:16 devstack sudo[104187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 Sep 28 17:22:16 devstack sudo[104187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:16 devstack sudo[104187]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846" returned: 0 in 0.436s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:16 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846 Sep 28 17:22:16 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-84622daa-a84b-484a-91b3-66ccf6fca846" returned: 0 in 0.271s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-84622daa-a84b-484a-91b3-66ccf6fca846" released by "delete_volume" :: held 0.750s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Created reservations ['c2efbfb4-ff8a-4303-8b3b-3de64103cbb2', 'e0de45ae-4a08-4386-816d-dae58d7e8570', '301646cc-5164-45fb-8144-ec9bb8bcc35f', '4a1f4f1a-5af3-4af3-b8aa-f917f99527ed'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:17 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:17 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-d935d0c7-84a7-4543-ac8b-2cd26ebee544-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-d935d0c7-84a7-4543-ac8b-2cd26ebee544-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-quobyte-d935d0c7-84a7-4543-ac8b-2cd26ebee544" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:17 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.359s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-d935d0c7-84a7-4543-ac8b-2cd26ebee544" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Deleted volume successfully. Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2536fa7-1b82-4e46-b182-4def9540772a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-92bda441-2470-46bb-bfd6-d60673de738b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-84622daa-a84b-484a-91b3-66ccf6fca846-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:17 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 Sep 28 17:22:17 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:18 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544 Sep 28 17:22:18 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:18 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d935d0c7-84a7-4543-ac8b-2cd26ebee544" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-d935d0c7-84a7-4543-ac8b-2cd26ebee544" released by "delete_volume" :: held 0.759s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Created reservations ['5e8184cc-05f8-4e5e-9a76-7cfaf98765d4', '416521b5-b5d1-4854-a9bf-8de449975f09', 'aa71d3eb-43d8-40bc-add0-f0e9e27f74cf', 'beea42be-c5aa-433c-a663-29e6215b7616'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:18 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-8c071335-799b-4082-ac2a-63f9da692df3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-8c071335-799b-4082-ac2a-63f9da692df3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-quobyte-8c071335-799b-4082-ac2a-63f9da692df3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-8c071335-799b-4082-ac2a-63f9da692df3" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[20545c6f-a2ee-4185-a224-d3b382c038e2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:18 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.329s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Deleted volume successfully. Sep 28 17:22:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b21570fa-f120-4976-a7bf-4b319930aa2b tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-d935d0c7-84a7-4543-ac8b-2cd26ebee544-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:19 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 Sep 28 17:22:19 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3" returned: 0 in 0.405s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:19 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3 Sep 28 17:22:19 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8c071335-799b-4082-ac2a-63f9da692df3" returned: 0 in 0.267s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-8c071335-799b-4082-ac2a-63f9da692df3" released by "delete_volume" :: held 0.733s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Created reservations ['b6bb77b0-b85d-4f24-b0b6-d82c371e1de4', 'e4b3f5b8-6c94-4d99-acd2-1463fe48ef8d', 'c18bd982-d706-4215-bed1-870e28580218', 'daf8152c-ceaf-40a8-8ccd-06d52fe81465'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:19 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:19 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-9acaa5f1-5fa1-458f-b65c-13d96203e3ac-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-9acaa5f1-5fa1-458f-b65c-13d96203e3ac-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-quobyte-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:20 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.350s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Deleted volume successfully. Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[696bf007-5ddc-4772-9c69-545070ceff3d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-524e3e37-50d6-4cdc-9226-4bc8f2a658eb tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-8c071335-799b-4082-ac2a-63f9da692df3-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:20 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac Sep 28 17:22:20 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:20 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" returned: 0 in 0.405s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac Sep 28 17:22:20 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:20 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" returned: 0 in 0.250s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-9acaa5f1-5fa1-458f-b65c-13d96203e3ac" released by "delete_volume" :: held 0.712s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Created reservations ['87b52aec-23f1-4e09-b081-6530a181aca2', '026c8636-e9fc-45d6-963c-d258b61c9ebb', '4fa566e7-8985-43a0-ba36-1cc8cecc72b1', '3529512a-a236-4c16-84f0-7a2c9913f425'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:20 devstack sudo[104228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:20 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-47c4653e-f9a8-4c03-96b9-57483d692287-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Deleted volume successfully. Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-47c4653e-f9a8-4c03-96b9-57483d692287-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c3c73275-d4ca-4dc8-b651-59e2c059152d tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-9acaa5f1-5fa1-458f-b65c-13d96203e3ac-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "cinder-quobyte-47c4653e-f9a8-4c03-96b9-57483d692287" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-47c4653e-f9a8-4c03-96b9-57483d692287" acquired by "delete_volume" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb40454-1687-4f54-adc0-72285c2e7a00]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 Sep 28 17:22:21 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287" returned: 0 in 0.387s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:21 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287 Sep 28 17:22:21 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:21 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47c4653e-f9a8-4c03-96b9-57483d692287" returned: 0 in 0.266s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-quobyte-47c4653e-f9a8-4c03-96b9-57483d692287" released by "delete_volume" :: held 0.700s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Created reservations ['581d2bf7-46e2-4883-8010-00927cfb0b33', '541ac6bc-dfe8-4846-ba5e-f3d671739f90', '9d44e840-4aaa-443b-b048-cbc04e9f02a3', '750dfc9c-9dbe-4036-ae98-9b0433d40e5b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:22 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:22 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:22 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.285s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Deleted volume successfully. Sep 28 17:22:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30a6663e-d172-4cdb-9954-ee83c8bea203 tempest-CreateVolumesFromImageTest-113518560 None] Lock "cinder-47c4653e-f9a8-4c03-96b9-57483d692287-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2921707e-8dfa-486f-b3f9-9708c8d51b0c req-c8619fd2-f99f-4f74-87cc-33e37379b347 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2921707e-8dfa-486f-b3f9-9708c8d51b0c req-c8619fd2-f99f-4f74-87cc-33e37379b347 tempest-TestStampPattern-1085590122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-2921707e-8dfa-486f-b3f9-9708c8d51b0c req-c8619fd2-f99f-4f74-87cc-33e37379b347 tempest-TestStampPattern-1085590122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-2921707e-8dfa-486f-b3f9-9708c8d51b0c req-c8619fd2-f99f-4f74-87cc-33e37379b347 tempest-TestStampPattern-1085590122 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4', 'name': 'volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7602b0fb-8004-407d-b65a-65c996e72f11', 'enforce_multipath': True} {{(pid=86842) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 17:22:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-2921707e-8dfa-486f-b3f9-9708c8d51b0c req-c8619fd2-f99f-4f74-87cc-33e37379b347 tempest-TestStampPattern-1085590122 None] attachment_update completed successfully. Sep 28 17:22:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-ec61d2c7-87c8-4751-ba68-127755431716 req-ac907686-668e-4a20-9a9e-68511f8342b1 tempest-TestStampPattern-1085590122 None] Terminate volume connection completed successfully. Sep 28 17:22:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-ec61d2c7-87c8-4751-ba68-127755431716 req-ac907686-668e-4a20-9a9e-68511f8342b1 tempest-TestStampPattern-1085590122 None] Deleting attachment 7602b0fb-8004-407d-b65a-65c996e72f11. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "cinder-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19dc777-15d4-48ed-948d-9660b5ec7a20]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 Sep 28 17:22:35 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317 Sep 28 17:22:35 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" returned: 0 in 0.260s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317" released by "delete_volume" :: held 0.683s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Created reservations ['ab4ed823-2e95-47c3-95b2-b953027d20f0', '8e0c6c7e-0358-4f97-b8e5-5c71addb835c', '4a75b6af-e386-417a-85ff-19187092eeb0', '6c78bd9d-b3da-46ea-b536-c8501423f135'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:35 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:35 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:35 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.253s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Deleted volume successfully. Sep 28 17:22:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0762209a-900c-40c0-9e89-b34142b84bc3 tempest-TestStampPattern-1085590122 None] Lock "cinder-aa1ecd89-45ca-4ab1-8bb3-b2cbc5b14317-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Deleting offline snapshot a2960997-67fa-4ffd-ad6d-6cb69ce2523d of volume 9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] snapshot_file for this snap is: volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba1b10-67b6-4241-8d49-14404f36a58b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:22:36 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:36 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c695dff-bc2b-4d2c-b619-983c16527576(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee50a2cd-f233-427a-8a2a-7c7ed3019586]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:36 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:22:36 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.538s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:22:37 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.376s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:37 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d Sep 28 17:22:37 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:37 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576.a2960997-67fa-4ffd-ad6d-6cb69ce2523d" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-a2960997-67fa-4ffd-ad6d-6cb69ce2523d" released by "_delete_snapshot" :: held 1.705s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" released by "delete_snapshot" :: held 1.730s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:38 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Created reservations ['b6849801-080d-44a7-ba7a-7461c379fe53', '8b5f9891-b4ca-42f2-97aa-0ba70f399266', '57572ed4-d5dd-4781-a891-520fa1015ad3', '67bc5af4-a9c8-45a2-afb2-ef46199a46c9'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Delete snapshot completed successfully. Sep 28 17:22:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c531a9c1-fbd8-43a5-97e3-05bd700208c1 tempest-TestStampPattern-1085590122 None] Lock "cinder-a2960997-67fa-4ffd-ad6d-6cb69ce2523d-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-9c695dff-bc2b-4d2c-b619-983c16527576-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "cinder-9c695dff-bc2b-4d2c-b619-983c16527576-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=65,cinder:UPDATE=86,cinder:INSERT=16,cinder:DELETE=8 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Acquiring lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc92131-e08b-4458-80a4-e049379cf48f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:22:42 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:42 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.470s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:42 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576 Sep 28 17:22:42 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9c695dff-bc2b-4d2c-b619-983c16527576" returned: 0 in 0.268s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "cinder-quobyte-9c695dff-bc2b-4d2c-b619-983c16527576" released by "delete_volume" :: held 0.802s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Created reservations ['94c5a049-c52e-424a-81dc-485c9c17c939', '55ad668b-b758-4fb1-8e0b-c96e93d42777', 'cf9dc8de-a25f-4ef2-85df-db23cd5f6c94', '15e922cb-3562-46cf-97b8-ad539ad17106'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:43 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:43 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:43 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.286s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Deleted volume successfully. Sep 28 17:22:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a2d3740a-10bf-46ca-bb7c-ae2e60f86dd4 tempest-TestStampPattern-1085590122 None] Lock "cinder-9c695dff-bc2b-4d2c-b619-983c16527576-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:44 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:44 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:44 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.303s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:22:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:22:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-e3bdb95a-a2ff-49de-9d8b-d1683559283b tempest-TestShelveInstance-1077567384 None] Terminate volume connection completed successfully. Sep 28 17:22:48 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-e3bdb95a-a2ff-49de-9d8b-d1683559283b tempest-TestShelveInstance-1077567384 None] Deleting attachment 70f5f703-cd6c-4a0d-be91-aa3ca2c84da3. {{(pid=86842) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 17:22:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Acquiring lock "cinder-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "cinder-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Acquiring lock "cinder-quobyte-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "cinder-quobyte-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b598622-83fd-4bb6-a8ff-1c9ed1b71358]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:49 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 Sep 28 17:22:49 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:49 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" returned: 0 in 0.545s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:49 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93 Sep 28 17:22:49 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "cinder-quobyte-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93" released by "delete_volume" :: held 1.041s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.quota [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Created reservations ['3ae80eae-bc7c-4a04-ad99-1b7ee686ff85', '91178c13-9934-4d42-8721-a258659e30c6', '37654315-0029-4452-bf03-cba2fefefc31', '5a4c8712-2fbb-4c7c-bf31-5c153e87fa0b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:22:50 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:22:50 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:22:50 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.462s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.manager [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:22:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Deleted volume successfully. Sep 28 17:22:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [req-6ade7581-447d-4d2f-b60d-05288e3ac145 req-b42a5c1e-bea1-4eb5-bc55-96b3e6f3c904 tempest-TestShelveInstance-1077567384 None] Lock "cinder-bcb2cfae-7e10-40ac-af3e-cc65e2ca9f93-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:00 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=77,cinder:UPDATE=87,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:00 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Flow 'volume_create_manager' (02cab7e5-6475-443b-80fb-c14c29143a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a5e27-6546-4ce0-bab0-1eb5858a42e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (603a5e27-6546-4ce0-bab0-1eb5858a42e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1563acf84d0430b9c0f8c07ca18c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='417681fab676440abad92e1edbaa9a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e688fd08-334a-46ea-a6b7-ad6691494e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e688fd08-334a-46ea-a6b7-ad6691494e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d546e4d8-8666-4bf8-8e5e-779d43369da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d546e4d8-8666-4bf8-8e5e-779d43369da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08', 'volume_name': 'volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c164e60-1745-40aa-a47f-b7cc6ed1e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c164e60-1745-40aa-a47f-b7cc6ed1e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2286060d-1bf2-4ce6-aa07-9bc40965efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Volume c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08', 'volume_size': 1} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1563acf84d0430b9c0f8c07ca18c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:01Z,use_quota=True,user_id='417681fab676440abad92e1edbaa9a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Creating volume c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 1073741824 Sep 28 17:23:01 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:01 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 1073741824" returned: 0 in 0.578s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:01 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 Sep 28 17:23:01 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:02 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" returned: 0 in 0.264s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2286060d-1bf2-4ce6-aa07-9bc40965efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c4cc0e-7164-47c4-a058-07b5b3fc63b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Volume volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 (c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08): created successfully Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01c4cc0e-7164-47c4-a058-07b5b3fc63b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Flow 'volume_create_manager' (02cab7e5-6475-443b-80fb-c14c29143a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b6395380-588a-45a3-a640-4c2179b01556 tempest-CinderUnicodeTest-339375503 None] Created volume successfully. Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Flow 'volume_create_manager' (0ca5e8f4-ba01-49ca-a6fd-68e9f1fe105b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60d0e1-1785-4192-8112-2bda554d24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a60d0e1-1785-4192-8112-2bda554d24a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919035932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a19ded-b5a7-4210-8d71-e714c79616c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1563acf84d0430b9c0f8c07ca18c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='417681fab676440abad92e1edbaa9a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10d379-5698-4191-8464-14ae7ffc6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d10d379-5698-4191-8464-14ae7ffc6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d2f29-cfb5-4270-a003-7042c9fadee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875d2f29-cfb5-4270-a003-7042c9fadee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a19ded-b5a7-4210-8d71-e714c79616c7', 'volume_name': 'volume-61a19ded-b5a7-4210-8d71-e714c79616c7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456577f8-f6fa-4bb6-afa9-644bbc11756b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (456577f8-f6fa-4bb6-afa9-644bbc11756b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365dfe6f-4209-4a48-85a6-142701cda400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Volume 61a19ded-b5a7-4210-8d71-e714c79616c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a19ded-b5a7-4210-8d71-e714c79616c7', 'volume_size': 1} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1919035932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a19ded-b5a7-4210-8d71-e714c79616c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1563acf84d0430b9c0f8c07ca18c545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:04Z,use_quota=True,user_id='417681fab676440abad92e1edbaa9a1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Creating volume 61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:03 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:03 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 1073741824 Sep 28 17:23:03 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 1073741824" returned: 0 in 0.453s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:04 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 Sep 28 17:23:04 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:04 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7" returned: 0 in 0.293s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365dfe6f-4209-4a48-85a6-142701cda400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a19ded-b5a7-4210-8d71-e714c79616c7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ffae12-e781-4abf-9a7b-231bcd313103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Volume volume-61a19ded-b5a7-4210-8d71-e714c79616c7 (61a19ded-b5a7-4210-8d71-e714c79616c7): created successfully Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51ffae12-e781-4abf-9a7b-231bcd313103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Flow 'volume_create_manager' (0ca5e8f4-ba01-49ca-a6fd-68e9f1fe105b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f69dc777-e4eb-4609-b865-cc69f6358c9a tempest-CinderUnicodeTest-339375503 None] Created volume successfully. Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Creating offline snapshot 291114be-295b-47aa-8622-e083f7e91460 of volume 61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c495b1-f633-4c34-91b6-94fc1c3c40ed]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 Sep 28 17:23:06 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:06 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7" returned: 0 in 0.404s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:06 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 1G Sep 28 17:23:06 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 1G" returned: 0 in 0.508s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a19ded-b5a7-4210-8d71-e714c79616c7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a19ded-b5a7-4210-8d71-e714c79616c7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 Sep 28 17:23:07 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a19ded-b5a7-4210-8d71-e714c79616c7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 is being set with open permissions: ugo+rw Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 Sep 28 17:23:07 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:07 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:07 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info Sep 28 17:23:07 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info" returned: 0 in 0.297s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info is being set with open permissions: ugo+rw Sep 28 17:23:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:08 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info Sep 28 17:23:08 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:08 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.info" returned: 0 in 0.290s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ef77cae7-bc9b-487c-b398-2bd8d169f5b9 tempest-CinderUnicodeTest-339375503 None] Create snapshot completed successfully Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-291114be-295b-47aa-8622-e083f7e91460-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-291114be-295b-47aa-8622-e083f7e91460-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-quobyte-291114be-295b-47aa-8622-e083f7e91460" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-291114be-295b-47aa-8622-e083f7e91460" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Deleting offline snapshot 291114be-295b-47aa-8622-e083f7e91460 of volume 61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] snapshot_file for this snap is: volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[59044490-08c6-414b-9b38-824fd7bec70a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:09 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 Sep 28 17:23:09 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460" returned: 0 in 0.471s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61a19ded-b5a7-4210-8d71-e714c79616c7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[45157572-e932-4f22-9e41-d6ad94612543]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 Sep 28 17:23:10 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:10 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7" returned: 0 in 0.450s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:10 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 Sep 28 17:23:10 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460" returned: 0 in 0.490s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:11 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460 Sep 28 17:23:11 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:11 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7.291114be-295b-47aa-8622-e083f7e91460" returned: 0 in 0.329s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-291114be-295b-47aa-8622-e083f7e91460" released by "_delete_snapshot" :: held 1.897s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" released by "delete_snapshot" :: held 1.932s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Created reservations ['29ad0f70-bb43-4d37-9903-b7c34cbc8da4', '96ebc1b3-031e-4b49-8f69-b12629b1b305', '178dcfe4-2c88-4f62-b84c-1535b9d2a7c8', '5dd83cd8-816b-4f95-bc33-9d7f815db310'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Delete snapshot completed successfully. Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-ab7e2d0e-a190-4abb-8ef7-232309de0b9d tempest-CinderUnicodeTest-339375503 None] Lock "cinder-291114be-295b-47aa-8622-e083f7e91460-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-61a19ded-b5a7-4210-8d71-e714c79616c7-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-61a19ded-b5a7-4210-8d71-e714c79616c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7e6e59-f859-4bfd-bfe2-6056f1181526]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 Sep 28 17:23:12 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7" returned: 0 in 0.471s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[104598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7 Sep 28 17:23:12 devstack sudo[104598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack sudo[104598]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-61a19ded-b5a7-4210-8d71-e714c79616c7" returned: 0 in 0.314s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-61a19ded-b5a7-4210-8d71-e714c79616c7" released by "delete_volume" :: held 0.890s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Created reservations ['af84ea28-18d3-46ef-a5d1-a7ee7222f4af', 'b02a7fbd-d3a5-4351-b1ba-2b4395be3174', '8e275c92-c9a0-46bc-9e6a-1c3bfa8c4804', 'c0595e45-8140-4e3e-b6bc-7cdf709c4f10'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:12 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:12 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "cinder-quobyte-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[78060c01-da8c-49b7-984c-e83c47078944]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.380s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Deleted volume successfully. Sep 28 17:23:13 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 Sep 28 17:23:13 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c00288-9a06-4115-9d7b-983e86eb0c21 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-61a19ded-b5a7-4210-8d71-e714c79616c7-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:13 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:13 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08 Sep 28 17:23:13 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:13 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-quobyte-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08" released by "delete_volume" :: held 0.844s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Created reservations ['63be241f-f41b-46be-9b17-3628a4cde3a2', 'f272049d-976f-4812-bdaa-d61e6af76c71', '4490a432-2e09-4576-8a38-f6f39c11d0f4', 'a5228c57-9d21-4103-8c16-97f040cfd2af'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:14 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:14 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:14 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.397s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:14 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Deleted volume successfully. Sep 28 17:23:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-87e44f7a-7c46-4791-8ae1-5c686f88be36 tempest-CinderUnicodeTest-339375503 None] Lock "cinder-c36cbf63-2d0f-4f6a-b2eb-de2af90f5d08-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (a9a7de6f-b39c-4fcd-844d-46d9ace8bc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f836890-a7cc-4531-9928-c4c73d27f649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f836890-a7cc-4531-9928-c4c73d27f649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315879514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090047b5-556a-4498-83da-7c718eaa3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:19Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a795ea14-c5ec-4538-8594-2ab1116b2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a795ea14-c5ec-4538-8594-2ab1116b2699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd43819-4708-4a93-9b58-13c696c7cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd43819-4708-4a93-9b58-13c696c7cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090047b5-556a-4498-83da-7c718eaa3eca', 'volume_name': 'volume-090047b5-556a-4498-83da-7c718eaa3eca', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4826aac0-5711-464b-8303-8298626e2cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4826aac0-5711-464b-8303-8298626e2cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d29b8-eb9a-45fe-a24b-49c535cc2cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Volume 090047b5-556a-4498-83da-7c718eaa3eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090047b5-556a-4498-83da-7c718eaa3eca', 'volume_size': 1} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315879514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090047b5-556a-4498-83da-7c718eaa3eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:19Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Creating volume 090047b5-556a-4498-83da-7c718eaa3eca {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:18 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:18 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca 1073741824 Sep 28 17:23:18 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca 1073741824" returned: 0 in 0.594s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:19 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca Sep 28 17:23:19 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:19 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca" returned: 0 in 0.295s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67d29b8-eb9a-45fe-a24b-49c535cc2cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090047b5-556a-4498-83da-7c718eaa3eca', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027a3d9-1e76-4e93-87f2-3f1003a9fb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:19 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Volume volume-090047b5-556a-4498-83da-7c718eaa3eca (090047b5-556a-4498-83da-7c718eaa3eca): created successfully Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5027a3d9-1e76-4e93-87f2-3f1003a9fb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (a9a7de6f-b39c-4fcd-844d-46d9ace8bc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d10df085-f755-4863-8e90-5a0ae6a52e97 tempest-ProjectReaderTests-187202920 None] Created volume successfully. Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-090047b5-556a-4498-83da-7c718eaa3eca-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "cinder-090047b5-556a-4498-83da-7c718eaa3eca-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-quobyte-090047b5-556a-4498-83da-7c718eaa3eca" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-090047b5-556a-4498-83da-7c718eaa3eca" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[883d9de6-ed9f-4951-afeb-440d5b6e40df]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca Sep 28 17:23:21 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:21 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca" returned: 0 in 0.469s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:21 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca Sep 28 17:23:21 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-090047b5-556a-4498-83da-7c718eaa3eca" returned: 0 in 0.340s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-090047b5-556a-4498-83da-7c718eaa3eca" released by "delete_volume" :: held 0.868s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Created reservations ['4d87f945-bacb-45b6-b77c-a6aff7b65385', '2e01d7c8-c5a6-4a5e-869c-abec17a5ac26', 'd0e90f1a-64d2-4e11-9a2c-1743262b9433', 'a9cc62ef-f0fd-4aaf-ace9-374f44ab3de9'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:22 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:22 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:22 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.403s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Deleted volume successfully. Sep 28 17:23:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5d99b8b2-16c6-4726-8b8d-183727199475 tempest-ProjectReaderTests-187202920 None] Lock "cinder-090047b5-556a-4498-83da-7c718eaa3eca-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (d2400fa8-8e24-49d9-9c09-0be24444dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfcbb0b-fe1e-4ef9-9b58-46ff3ae9365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfcbb0b-fe1e-4ef9-9b58-46ff3ae9365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513597271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e42c75d-43a1-4e3c-90c8-103aa37795c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:23Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81271dd-97c9-4ff8-a94d-cf84bcce6f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81271dd-97c9-4ff8-a94d-cf84bcce6f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e939a6-884f-42e0-9a2f-8d87aef1c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e939a6-884f-42e0-9a2f-8d87aef1c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e42c75d-43a1-4e3c-90c8-103aa37795c0', 'volume_name': 'volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faf8cb9-ef2b-4a9d-a1ef-4c1d66c5fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4faf8cb9-ef2b-4a9d-a1ef-4c1d66c5fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed17126b-94a4-48d7-b9d7-749eaabd4b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Volume 2e42c75d-43a1-4e3c-90c8-103aa37795c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0', 'volume_size': 1} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-513597271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e42c75d-43a1-4e3c-90c8-103aa37795c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:23Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Creating volume 2e42c75d-43a1-4e3c-90c8-103aa37795c0 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:23 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 1073741824 Sep 28 17:23:23 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:23 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 1073741824" returned: 0 in 0.547s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:23 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 Sep 28 17:23:23 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:24 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0" returned: 0 in 0.273s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed17126b-94a4-48d7-b9d7-749eaabd4b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce0f521-6c98-4345-8164-623588e38f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:24 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Volume volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 (2e42c75d-43a1-4e3c-90c8-103aa37795c0): created successfully Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce0f521-6c98-4345-8164-623588e38f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:24 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (d2400fa8-8e24-49d9-9c09-0be24444dd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:24 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-91196897-0462-4b92-bd84-04260c89000a tempest-ProjectReaderTests-187202920 None] Created volume successfully. Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-2e42c75d-43a1-4e3c-90c8-103aa37795c0-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "cinder-2e42c75d-43a1-4e3c-90c8-103aa37795c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-quobyte-2e42c75d-43a1-4e3c-90c8-103aa37795c0" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-2e42c75d-43a1-4e3c-90c8-103aa37795c0" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[182bfbcf-b389-4a37-ad9b-9712e6684cf0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 Sep 28 17:23:25 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:25 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0" returned: 0 in 0.398s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:25 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0 Sep 28 17:23:25 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-2e42c75d-43a1-4e3c-90c8-103aa37795c0" returned: 0 in 0.385s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-2e42c75d-43a1-4e3c-90c8-103aa37795c0" released by "delete_volume" :: held 0.837s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Created reservations ['d0550b89-a6e7-44bc-b6c2-038e495f81a9', '19a6a14b-09b6-47d8-8141-3fc1cf8d9d37', '2c741635-c0c6-4127-acba-da8d21b788c0', '03710c9c-4140-455d-9cdf-05e0e3fecc94'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:26 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:26 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:26 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:26 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Deleted volume successfully. Sep 28 17:23:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8ed85fa0-b828-4eb8-841c-79d87d58211f tempest-ProjectReaderTests-187202920 None] Lock "cinder-2e42c75d-43a1-4e3c-90c8-103aa37795c0-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (8dd0b173-f0ef-4f64-811e-038486dca57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5e3169-baa4-4e2a-b865-0afd9aeb38aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5e3169-baa4-4e2a-b865-0afd9aeb38aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017947697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5af33a1-d5ad-437e-a328-3bc8b876b513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:27Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d4aec-5055-4b7f-8bdb-31a445f94c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3d4aec-5055-4b7f-8bdb-31a445f94c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804533f-4d43-4e20-9849-75f051eac1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9804533f-4d43-4e20-9849-75f051eac1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5af33a1-d5ad-437e-a328-3bc8b876b513', 'volume_name': 'volume-f5af33a1-d5ad-437e-a328-3bc8b876b513', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e890a1-437b-4b12-9611-b2d2aea751ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69e890a1-437b-4b12-9611-b2d2aea751ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f735c4-8e8b-477c-8f8b-1d688a298c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Volume f5af33a1-d5ad-437e-a328-3bc8b876b513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5af33a1-d5ad-437e-a328-3bc8b876b513', 'volume_size': 1} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017947697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5af33a1-d5ad-437e-a328-3bc8b876b513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:27Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Creating volume f5af33a1-d5ad-437e-a328-3bc8b876b513 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:27 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 1073741824 Sep 28 17:23:27 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Flow 'volume_create_manager' (2ee59731-750b-4b7f-881f-a3365909bd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8277dc-3fa9-4534-9f9e-486c8d98a750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8277dc-3fa9-4534-9f9e-486c8d98a750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-124852465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65890222-987d-4c98-a0b8-abe64ceeb137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b715c45a9e480dba191d0d92f52163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:27Z,use_quota=True,user_id='ca0c7e99637741308a0cc9c047d9e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9f09e1-4234-4c25-b4a1-c63f80fc7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9f09e1-4234-4c25-b4a1-c63f80fc7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c1662c-d47d-432e-9477-e4a2d84410df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c1662c-d47d-432e-9477-e4a2d84410df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65890222-987d-4c98-a0b8-abe64ceeb137', 'volume_name': 'volume-65890222-987d-4c98-a0b8-abe64ceeb137', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44482214-e137-4daf-95c1-b958c6ece2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44482214-e137-4daf-95c1-b958c6ece2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7121e610-833c-4824-937f-dbe90e96e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Volume 65890222-987d-4c98-a0b8-abe64ceeb137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65890222-987d-4c98-a0b8-abe64ceeb137', 'volume_size': 1} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:27 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 1073741824" returned: 0 in 0.486s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:27 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 Sep 28 17:23:27 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513" returned: 0 in 0.303s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-124852465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65890222-987d-4c98-a0b8-abe64ceeb137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01b715c45a9e480dba191d0d92f52163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:27Z,use_quota=True,user_id='ca0c7e99637741308a0cc9c047d9e21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Creating volume 65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:28 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f735c4-8e8b-477c-8f8b-1d688a298c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5af33a1-d5ad-437e-a328-3bc8b876b513', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246bd28-7fba-4cb3-aee6-3b05950fc64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:28 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 1073741824 Sep 28 17:23:28 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:28 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Volume volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 (f5af33a1-d5ad-437e-a328-3bc8b876b513): created successfully Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2246bd28-7fba-4cb3-aee6-3b05950fc64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (8dd0b173-f0ef-4f64-811e-038486dca57f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e55ecc97-eb28-4db5-98e1-baa6c18cd850 tempest-ProjectReaderTests-187202920 None] Created volume successfully. Sep 28 17:23:28 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 1073741824" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:28 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:28 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.283s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7121e610-833c-4824-937f-dbe90e96e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65890222-987d-4c98-a0b8-abe64ceeb137', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9218b14-75f5-4c96-9c66-6b68a46e5c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Volume volume-65890222-987d-4c98-a0b8-abe64ceeb137 (65890222-987d-4c98-a0b8-abe64ceeb137): created successfully Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9218b14-75f5-4c96-9c66-6b68a46e5c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Flow 'volume_create_manager' (2ee59731-750b-4b7f-881f-a3365909bd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c8d30841-82ef-4ea7-8b7d-421619c7c871 tempest-TestImageHashVerification-676383047 None] Created volume successfully. Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-f5af33a1-d5ad-437e-a328-3bc8b876b513-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "cinder-f5af33a1-d5ad-437e-a328-3bc8b876b513-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-quobyte-f5af33a1-d5ad-437e-a328-3bc8b876b513" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-f5af33a1-d5ad-437e-a328-3bc8b876b513" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc94ac8-89c1-4f4d-926c-63ec53d97f58]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 Sep 28 17:23:29 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:29 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513" returned: 0 in 0.458s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:29 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513 Sep 28 17:23:29 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f5af33a1-d5ad-437e-a328-3bc8b876b513" returned: 0 in 0.271s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-f5af33a1-d5ad-437e-a328-3bc8b876b513" released by "delete_volume" :: held 0.780s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Created reservations ['63ba9068-19cf-4673-ad3b-c47dd36791be', 'efe5f9cc-6f9d-410d-ba71-328238771802', '5da69510-65f3-445d-b9d2-f00752561e42', '2c9eaaab-5079-48b8-a369-68115e3801fe'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:30 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a78100-54ab-4ade-9d84-334b34954720]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:30 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Deleted volume successfully. Sep 28 17:23:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1efbee07-17cf-45cb-92d7-631b0a338b16 tempest-ProjectReaderTests-187202920 None] Lock "cinder-f5af33a1-d5ad-437e-a328-3bc8b876b513-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:23:30 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:30 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.445s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7605accc-3217-42a6-90b0-d63ec2d9d34d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (045eea44-5dc9-4789-bc49-9b6cc56bd8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2fcf5f-7c14-4e4f-9f44-66d748540390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2fcf5f-7c14-4e4f-9f44-66d748540390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556553213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c16f0b-60bd-4a96-9a24-b1cb08ac6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:31Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05311a87-4fbf-4fa4-9ca0-ea7f6767e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05311a87-4fbf-4fa4-9ca0-ea7f6767e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:31 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:31 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f62f57a-e750-4b85-b712-2615c66d6951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f62f57a-e750-4b85-b712-2615c66d6951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c16f0b-60bd-4a96-9a24-b1cb08ac6922', 'volume_name': 'volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d657a6-9f29-4d71-82cd-38bba3a3c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d657a6-9f29-4d71-82cd-38bba3a3c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149110e9-1f3d-4069-9060-4c80e80d3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Volume 57c16f0b-60bd-4a96-9a24-b1cb08ac6922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922', 'volume_size': 1} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:31 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 /opt/stack/data/cinder/conversion/65890222-987d-4c98-a0b8-abe64ceeb137.temp_image.04a56022-b410-41cf-a306-46422e3b199bsvllwhkh.img {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:31 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 /opt/stack/data/cinder/conversion/65890222-987d-4c98-a0b8-abe64ceeb137.temp_image.04a56022-b410-41cf-a306-46422e3b199bsvllwhkh.img Sep 28 17:23:31 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:37 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 /opt/stack/data/cinder/conversion/65890222-987d-4c98-a0b8-abe64ceeb137.temp_image.04a56022-b410-41cf-a306-46422e3b199bsvllwhkh.img" returned: 0 in 5.921s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebab8ffc-9683-46bf-91a2-97ccc9e5978a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:37 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:37 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:38 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.538s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:38 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/conversion/65890222-987d-4c98-a0b8-abe64ceeb137.temp_image.04a56022-b410-41cf-a306-46422e3b199bsvllwhkh.img {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:23:38 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Converted 1024.00 MB image at 172.92 MB/s Sep 28 17:23:38 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] 04a56022-b410-41cf-a306-46422e3b199b was raw, no need to convert to raw {{(pid=86842) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:44 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:23:44 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:44 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:23:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:23:48 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=54,cinder:UPDATE=66,cinder:INSERT=12,cinder:DELETE=9 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:48 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=43,cinder:UPDATE=65,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.437s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Uploaded volume to glance image-id: 04a56022-b410-41cf-a306-46422e3b199b. {{(pid=86842) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.733s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556553213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c16f0b-60bd-4a96-9a24-b1cb08ac6922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='831907bcb24a429787f8c49352242a01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:23:31Z,use_quota=True,user_id='d30644a0d4a341b3a23206bc50cf0c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Creating volume 57c16f0b-60bd-4a96-9a24-b1cb08ac6922 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:23:58 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 1073741824 Sep 28 17:23:58 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b4201d92-f502-4437-894c-b2e9b17efac3 tempest-TestImageHashVerification-676383047 None] Copy volume to image completed successfully. Sep 28 17:23:58 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 1073741824" returned: 0 in 0.507s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:58 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 Sep 28 17:23:58 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:58 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149110e9-1f3d-4069-9060-4c80e80d3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a1964c-5cc3-4b96-8efe-3a03dbda9401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:23:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Volume volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 (57c16f0b-60bd-4a96-9a24-b1cb08ac6922): created successfully Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a1964c-5cc3-4b96-8efe-3a03dbda9401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:23:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Flow 'volume_create_manager' (045eea44-5dc9-4789-bc49-9b6cc56bd8b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:23:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-60beaa9b-d244-4a03-bffb-a369c0f5767d tempest-ProjectReaderTests-187202920 None] Created volume successfully. Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-57c16f0b-60bd-4a96-9a24-b1cb08ac6922-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "cinder-57c16f0b-60bd-4a96-9a24-b1cb08ac6922-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Acquiring lock "cinder-65890222-987d-4c98-a0b8-abe64ceeb137-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "cinder-65890222-987d-4c98-a0b8-abe64ceeb137-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Acquiring lock "cinder-quobyte-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Acquiring lock "cinder-quobyte-65890222-987d-4c98-a0b8-abe64ceeb137" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "cinder-quobyte-65890222-987d-4c98-a0b8-abe64ceeb137" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ac0e9-9114-480d-bf10-9c2d7eeb9343]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db2f58a-a2f1-4510-94a5-711456d0e9bb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:59 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 Sep 28 17:23:59 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.420s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137 Sep 28 17:23:59 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:23:59 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" returned: 0 in 0.476s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:23:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:23:59 devstack sudo[104787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922 Sep 28 17:23:59 devstack sudo[104787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-65890222-987d-4c98-a0b8-abe64ceeb137" returned: 0 in 0.291s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "cinder-quobyte-65890222-987d-4c98-a0b8-abe64ceeb137" released by "delete_volume" :: held 0.759s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack sudo[104787]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "cinder-quobyte-57c16f0b-60bd-4a96-9a24-b1cb08ac6922" released by "delete_volume" :: held 0.821s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Created reservations ['4413920b-30b6-4966-a751-559518877d81', '0e9ad90d-f782-432b-9c4d-65c62ed7a39f', '276b22e6-5aa2-47b2-bc89-41064531a5d5', '3078a712-e34e-4e5e-8f7e-979fbcff2e8b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Created reservations ['92760dac-dca8-4f6e-b65b-8bf8b35af223', '9fbacb83-3de9-4916-ba57-7ede18f59ad4', '84dc23da-1a51-48b9-9370-98fc9dec9feb', '8b6185a9-c75e-4293-bd2e-1dd9c81af292'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:00 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:00 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:00 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:00 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Deleted volume successfully. Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7e3a6dd8-8478-4a67-a81a-78ae6b76cf3a tempest-TestImageHashVerification-676383047 None] Lock "cinder-65890222-987d-4c98-a0b8-abe64ceeb137-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:00 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Deleted volume successfully. Sep 28 17:24:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-858caf24-c9da-401e-a08e-a25f39bce1cd tempest-ProjectReaderTests-187202920 None] Lock "cinder-57c16f0b-60bd-4a96-9a24-b1cb08ac6922-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:10 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=14,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:10 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=23,cinder:SELECT=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Flow 'volume_create_manager' (d72c73ef-c2cd-436a-9d38-00940913898f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2045c9e-7637-4951-9025-e2afcd9ca7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2045c9e-7637-4951-9025-e2afcd9ca7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8736ae-b2d0-45fe-a905-386c312943bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65a2810c4d24b7a8e1c08a924cd277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:17Z,use_quota=True,user_id='65b81b2f804f449fbacc7b23bb9f8e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5227cbd-b658-441b-ab00-6e610edafbd7),volume_type_id=d5227cbd-b658-441b-ab00-6e610edafbd7)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdb531f-0d4e-4376-a5e6-5945a27fc728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bdb531f-0d4e-4376-a5e6-5945a27fc728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518fccca-956e-47af-afe6-e65b8c22b6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518fccca-956e-47af-afe6-e65b8c22b6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de8736ae-b2d0-45fe-a905-386c312943bd', 'volume_name': 'volume-de8736ae-b2d0-45fe-a905-386c312943bd', 'volume_size': 1, 'image_id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45b917ca65ff210619a3bd6a2e9ba690', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c65a2810c4d24b7a8e1c08a924cd277f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7561d2e72b8b6f212ff190fa1212b66a31ae09673312cc0a8532ccbc20a318716d5ce99546c98185b858f68062da8f45e0ee3741df05dd2f2ec84f0bb351a9c8', 'id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82a66dbc-8c13-4455-85fe-de948e61fbe1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b561c8c-de82-4ad9-bb02-af5431e431be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b561c8c-de82-4ad9-bb02-af5431e431be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4912711-65b8-4f7c-af96-d28ff0f0a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Volume de8736ae-b2d0-45fe-a905-386c312943bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de8736ae-b2d0-45fe-a905-386c312943bd', 'volume_size': 1, 'image_id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45b917ca65ff210619a3bd6a2e9ba690', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c65a2810c4d24b7a8e1c08a924cd277f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7561d2e72b8b6f212ff190fa1212b66a31ae09673312cc0a8532ccbc20a318716d5ce99546c98185b858f68062da8f45e0ee3741df05dd2f2ec84f0bb351a9c8', 'id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82a66dbc-8c13-4455-85fe-de948e61fbe1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Trying to clone de8736ae-b2d0-45fe-a905-386c312943bd from image 82a66dbc-8c13-4455-85fe-de948e61fbe1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:24:17 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e85f69-3e67-45c2-a9c8-448083f5f9d4]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:17 devstack sudo[104806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:17 devstack sudo[104806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[104806]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:18 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Temporary image 82a66dbc-8c13-4455-85fe-de948e61fbe1 is fetched for user 65b81b2f804f449fbacc7b23bb9f8e1c. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f71fd3-1f2a-4180-964f-be9ea5ae0088]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:18 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:18 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:18 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:18 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de8736ae-b2d0-45fe-a905-386c312943bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65a2810c4d24b7a8e1c08a924cd277f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:17Z,use_quota=True,user_id='65b81b2f804f449fbacc7b23bb9f8e1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5227cbd-b658-441b-ab00-6e610edafbd7),volume_type_id=d5227cbd-b658-441b-ab00-6e610edafbd7)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Creating volume de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:19 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1073741824 Sep 28 17:24:19 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1073741824" returned: 0 in 0.453s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:19 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd Sep 28 17:24:19 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:19 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd" returned: 0 in 0.263s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Attempting download of 82a66dbc-8c13-4455-85fe-de948e61fbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}])) to volume de8736ae-b2d0-45fe-a905-386c312943bd. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f239a1a-7e8d-47c4-a43e-4ea7e199f554]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a Sep 28 17:24:20 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a" returned: 0 in 0.357s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[104836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a Sep 28 17:24:20 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:20 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a" returned: 1 in 0.360s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_82a66dbc-8c13-4455-85fe-de948e61fbe1_vxy12m2a' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9acdce-73a7-45e6-9735-bb5c38a27ccd]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:20 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:20 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD Sep 28 17:24:21 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD" returned: 1 in 0.413s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] 82a66dbc-8c13-4455-85fe-de948e61fbe1 was raw, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:21 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd Sep 28 17:24:21 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:21 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd" returned: 0 in 0.527s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_82a66dbc-8c13-4455-85fe-de948e61fbe1_y1ow5b33devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:21 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:24:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:22 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1G Sep 28 17:24:22 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:22 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd 1G" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Downloaded image 82a66dbc-8c13-4455-85fe-de948e61fbe1 ((None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}])) to volume de8736ae-b2d0-45fe-a905-386c312943bd successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Temporary image 82a66dbc-8c13-4455-85fe-de948e61fbe1 for user 65b81b2f804f449fbacc7b23bb9f8e1c is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Marking volume de8736ae-b2d0-45fe-a905-386c312943bd as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Copying metadata from image 82a66dbc-8c13-4455-85fe-de948e61fbe1 to de8736ae-b2d0-45fe-a905-386c312943bd. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Creating volume glance metadata for volume de8736ae-b2d0-45fe-a905-386c312943bd backed by image 82a66dbc-8c13-4455-85fe-de948e61fbe1 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '45b917ca65ff210619a3bd6a2e9ba690', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4912711-65b8-4f7c-af96-d28ff0f0a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8736ae-b2d0-45fe-a905-386c312943bd', 'volume_size': 1, 'image_id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/82a66dbc-8c13-4455-85fe-de948e61fbe1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '45b917ca65ff210619a3bd6a2e9ba690', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c65a2810c4d24b7a8e1c08a924cd277f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7561d2e72b8b6f212ff190fa1212b66a31ae09673312cc0a8532ccbc20a318716d5ce99546c98185b858f68062da8f45e0ee3741df05dd2f2ec84f0bb351a9c8', 'id': '82a66dbc-8c13-4455-85fe-de948e61fbe1', 'created_at': datetime.datetime(2026, 9, 28, 15, 24, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 24, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/82a66dbc-8c13-4455-85fe-de948e61fbe1/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49965add-7fac-4a5e-89d7-3b7f431155b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:22 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Volume volume-de8736ae-b2d0-45fe-a905-386c312943bd (de8736ae-b2d0-45fe-a905-386c312943bd): created successfully Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49965add-7fac-4a5e-89d7-3b7f431155b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Flow 'volume_create_manager' (d72c73ef-c2cd-436a-9d38-00940913898f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9c1c78a3-25f5-4a5e-86e5-0cfbf52e2975 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Created volume successfully. Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Acquiring lock "cinder-de8736ae-b2d0-45fe-a905-386c312943bd-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "cinder-de8736ae-b2d0-45fe-a905-386c312943bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Acquiring lock "cinder-quobyte-de8736ae-b2d0-45fe-a905-386c312943bd" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "cinder-quobyte-de8736ae-b2d0-45fe-a905-386c312943bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a37e2bd-72d0-4ed7-a984-378ec67eca6b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:23 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd Sep 28 17:24:23 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd" returned: 0 in 0.420s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd Sep 28 17:24:24 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:24 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de8736ae-b2d0-45fe-a905-386c312943bd" returned: 0 in 0.322s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "cinder-quobyte-de8736ae-b2d0-45fe-a905-386c312943bd" released by "delete_volume" :: held 0.793s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:24 devstack cinder-volume[86842]: WARNING cinder.quota [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:24 devstack cinder-volume[86842]: WARNING cinder.quota [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Created reservations ['d0834d11-7018-450b-8c9a-3c1a85182106', '9c759ead-8acd-4335-af57-c4e1c2ea59f6', 'fd00f81f-fb99-4fac-b749-28cb0fc7d295', '1a8003ad-be21-457d-84fe-98182354b153'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:24 devstack sudo[104869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:24 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:25 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:25 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Deleted volume successfully. Sep 28 17:24:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6cc5ef0c-bd75-4e92-a272-7e9e4335feb3 tempest-VolumeAndVolumeTypeFromImageTest-790551344 None] Lock "cinder-de8736ae-b2d0-45fe-a905-386c312943bd-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Flow 'volume_create_manager' (85d01511-eee1-4d80-87b2-7873bd29f166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950ecf4-bbb8-4dcf-aa4b-3caae26b5745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b950ecf4-bbb8-4dcf-aa4b-3caae26b5745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1466028745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d099d5-9345-49c9-941c-ca337ed20a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca42abd91ce4c09a1794d29a510575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:30Z,use_quota=True,user_id='fbc0e9f475ec49c1be82789f5a22fc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7a64bd-3d0a-46e3-b5a7-ae6ccd4a4e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7a64bd-3d0a-46e3-b5a7-ae6ccd4a4e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46aa0fe-b0c6-4a29-ad0a-27eacded0057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f46aa0fe-b0c6-4a29-ad0a-27eacded0057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d099d5-9345-49c9-941c-ca337ed20a0f', 'volume_name': 'volume-68d099d5-9345-49c9-941c-ca337ed20a0f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a731f39-43d9-4975-83b3-57c7d3341c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a731f39-43d9-4975-83b3-57c7d3341c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01e9040-5548-4cdc-9708-072792f943fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Volume 68d099d5-9345-49c9-941c-ca337ed20a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d099d5-9345-49c9-941c-ca337ed20a0f', 'volume_size': 1} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1466028745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d099d5-9345-49c9-941c-ca337ed20a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca42abd91ce4c09a1794d29a510575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:30Z,use_quota=True,user_id='fbc0e9f475ec49c1be82789f5a22fc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Creating volume 68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:30 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:30 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f 1073741824 Sep 28 17:24:30 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:30 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f 1073741824" returned: 0 in 0.465s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:30 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:30 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.246s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f01e9040-5548-4cdc-9708-072792f943fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d099d5-9345-49c9-941c-ca337ed20a0f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24554ebf-be21-4626-9d2b-e88441b90e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Volume volume-68d099d5-9345-49c9-941c-ca337ed20a0f (68d099d5-9345-49c9-941c-ca337ed20a0f): created successfully Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24554ebf-be21-4626-9d2b-e88441b90e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Flow 'volume_create_manager' (85d01511-eee1-4d80-87b2-7873bd29f166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f4f4a165-823a-4f4b-944a-27dfddfc58a6 tempest-VolumeDependencyTests-754635700 None] Created volume successfully. Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Creating offline snapshot e0d8dd2e-456f-48bb-bd69-325d0c4fd558 of volume 68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8b4337-854f-45e6-ab5a-66aa88416727]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:31 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:31 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.442s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:31 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 1G Sep 28 17:24:31 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 1G" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d099d5-9345-49c9-941c-ca337ed20a0f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:32 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d099d5-9345-49c9-941c-ca337ed20a0f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:32 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:32 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68d099d5-9345-49c9-941c-ca337ed20a0f -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.328s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:32 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 is being set with open permissions: ugo+rw Sep 28 17:24:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:32 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:32 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info Sep 28 17:24:33 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info" returned: 0 in 0.264s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info is being set with open permissions: ugo+rw Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:33 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info Sep 28 17:24:33 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:33 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.info" returned: 0 in 0.276s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.143s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-64532701-dd76-4c80-8e69-14f6f3c8413e tempest-VolumeDependencyTests-754635700 None] Create snapshot completed successfully Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Flow 'volume_create_manager' (a033761f-9fcc-4830-9fda-2b241278ac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e240723-83a9-4f40-9a4c-9ccc53c03f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e240723-83a9-4f40-9a4c-9ccc53c03f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-449329370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f7e5d7-86bb-4853-b509-5b62af6aa03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ca42abd91ce4c09a1794d29a510575b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0d8dd2e-456f-48bb-bd69-325d0c4fd558,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:24:35Z,use_quota=True,user_id='fbc0e9f475ec49c1be82789f5a22fc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432dad09-fda8-4d35-b24f-de8dd68619ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432dad09-fda8-4d35-b24f-de8dd68619ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b4f257-7597-4808-aea5-e5213b06fca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b4f257-7597-4808-aea5-e5213b06fca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '31f7e5d7-86bb-4853-b509-5b62af6aa03a', 'volume_name': 'volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a', 'volume_size': 1, 'snapshot_id': 'e0d8dd2e-456f-48bb-bd69-325d0c4fd558'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a85c02-c254-4f8d-b461-9d190bb76cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43a85c02-c254-4f8d-b461-9d190bb76cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04108065-aa4a-4086-909d-43300fa53df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Volume 31f7e5d7-86bb-4853-b509-5b62af6aa03a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a', 'volume_size': 1, 'snapshot_id': 'e0d8dd2e-456f-48bb-bd69-325d0c4fd558'} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-31f7e5d7-86bb-4853-b509-5b62af6aa03a" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-31f7e5d7-86bb-4853-b509-5b62af6aa03a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Creating volume 31f7e5d7-86bb-4853-b509-5b62af6aa03a from snapshot e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] snapshot: e0d8dd2e-456f-48bb-bd69-325d0c4fd558, volume: 31f7e5d7-86bb-4853-b509-5b62af6aa03a, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b580e3ce-45aa-49d3-a99c-7f6546a5d14e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:35 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:35 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.382s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d099d5-9345-49c9-941c-ca337ed20a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f38144-2c94-4202-b016-bb7b014287a8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:35 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:35 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:36 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.391s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:24:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:24:36 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:24:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:36 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a Sep 28 17:24:36 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:41 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a" returned: 0 in 5.598s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:41 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:24:41 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Converted 1024.00 MB image at 182.88 MB/s Sep 28 17:24:41 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a is being set with open permissions: ugo+rw Sep 28 17:24:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:41 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a Sep 28 17:24:41 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:42 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a" returned: 0 in 0.237s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" released by "_copy_volume_from_snapshot" :: held 6.697s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-31f7e5d7-86bb-4853-b509-5b62af6aa03a" released by "_create_volume_from_snapshot" :: held 6.767s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.783s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04108065-aa4a-4086-909d-43300fa53df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a', 'volume_size': 1, 'snapshot_id': 'e0d8dd2e-456f-48bb-bd69-325d0c4fd558'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38a46fc-b98e-4fea-969d-131d73fe2ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:24:42 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Volume volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a (31f7e5d7-86bb-4853-b509-5b62af6aa03a): created successfully Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b38a46fc-b98e-4fea-969d-131d73fe2ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Flow 'volume_create_manager' (a033761f-9fcc-4830-9fda-2b241278ac65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:24:42 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-442fb0d8-3fc9-4239-a946-661e929e2b9b tempest-VolumeDependencyTests-754635700 None] Created volume successfully. Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Deleting offline snapshot e0d8dd2e-456f-48bb-bd69-325d0c4fd558 of volume 68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] snapshot_file for this snap is: volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e95ab5-9416-4512-8c01-595b8100b926]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:43 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:43 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:43 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.408s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68d099d5-9345-49c9-941c-ca337ed20a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ccfeba-81c4-4c7a-bbe9-17188d0777e1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:43 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:43 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:43 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.548s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:43 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:43 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.461s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558 Sep 28 17:24:44 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:44 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:44 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:44 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f.e0d8dd2e-456f-48bb-bd69-325d0c4fd558" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-e0d8dd2e-456f-48bb-bd69-325d0c4fd558" released by "_delete_snapshot" :: held 1.877s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" released by "delete_snapshot" :: held 1.904s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:44 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Created reservations ['bdbab433-0593-4a9c-84fb-4c27e09ac494', '1a2d91a8-336a-48f4-9f93-2326852bcb47', 'f697f7bf-6d02-4f2e-9e17-def4db7bc003', '67f7e59b-9381-4dd1-bebb-a18bd213c71c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Delete snapshot completed successfully. Sep 28 17:24:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2926a321-d97f-4c20-bfd5-07b645262426 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-e0d8dd2e-456f-48bb-bd69-325d0c4fd558-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-68d099d5-9345-49c9-941c-ca337ed20a0f-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-68d099d5-9345-49c9-941c-ca337ed20a0f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa87ab33-9f8a-4899-91dd-e36a96ab3b6b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:45 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:45 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.375s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f Sep 28 17:24:45 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:45 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-68d099d5-9345-49c9-941c-ca337ed20a0f" returned: 0 in 0.260s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-68d099d5-9345-49c9-941c-ca337ed20a0f" released by "delete_volume" :: held 0.714s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Created reservations ['d8bb2ca3-0d2d-4602-bd38-424b198c03c6', '9e05cf76-94d3-4a10-ac97-c1b5fb44040d', '30f30cbd-7081-4a5c-9d58-ce9d4d26cd3c', 'f46994d2-39e5-479e-9706-3bc349686a74'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:45 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:45 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.269s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Deleted volume successfully. Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-31f7e5d7-86bb-4853-b509-5b62af6aa03a-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c70d50eb-c5f1-4628-b508-b1ec4ae52b55 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-68d099d5-9345-49c9-941c-ca337ed20a0f-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-31f7e5d7-86bb-4853-b509-5b62af6aa03a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" acquired by "delete_volume" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[686f1cc0-c7e9-4e6b-88a6-8efc312612b3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a Sep 28 17:24:46 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a" returned: 0 in 0.370s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:46 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a Sep 28 17:24:46 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:46 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-31f7e5d7-86bb-4853-b509-5b62af6aa03a" returned: 0 in 0.249s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-quobyte-31f7e5d7-86bb-4853-b509-5b62af6aa03a" released by "delete_volume" :: held 0.662s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Created reservations ['5c7ff6db-3f9c-4885-a8e5-63378cd24a80', '61f7367e-484a-4537-97fd-3aad7a5bd411', '66e0518a-e0e6-49ec-83e8-7e0e312cd569', 'f61a5a18-ce27-44d2-8c67-e7add2ed13b4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:24:47 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:24:47 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:24:47 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.270s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:24:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Deleted volume successfully. Sep 28 17:24:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0aad8be5-c4af-4c3a-ba4e-618f2614fd92 tempest-VolumeDependencyTests-754635700 None] Lock "cinder-31f7e5d7-86bb-4853-b509-5b62af6aa03a-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:24:57 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=45,cinder:SELECT=39,cinder:INSERT=13,cinder:DELETE=3 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:24:57 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=37,cinder:INSERT=17,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Flow 'volume_create_manager' (046b3ea4-358d-4cf6-9d16-bbecf39366f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db0b26-9ea5-4f86-ab8d-275d683a7526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db0b26-9ea5-4f86-ab8d-275d683a7526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-415721045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7b95c3-ff9a-4710-80d4-0122976d5350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e08a55af5f4e99b581d72d0d1c4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:17Z,use_quota=True,user_id='eb6e3eed299345caa17ef810b193188a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a29df1b-8f97-4129-839b-89ed200b6879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a29df1b-8f97-4129-839b-89ed200b6879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dfe552-887e-4b1f-9101-ed17285c6f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8dfe552-887e-4b1f-9101-ed17285c6f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a7b95c3-ff9a-4710-80d4-0122976d5350', 'volume_name': 'volume-0a7b95c3-ff9a-4710-80d4-0122976d5350', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f4c42-0b76-4c31-91ed-725ea26f82e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f4c42-0b76-4c31-91ed-725ea26f82e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a8ef8d-3aee-47ff-b56b-985bf372879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Volume 0a7b95c3-ff9a-4710-80d4-0122976d5350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a7b95c3-ff9a-4710-80d4-0122976d5350', 'volume_size': 1} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-415721045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a7b95c3-ff9a-4710-80d4-0122976d5350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e08a55af5f4e99b581d72d0d1c4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:17Z,use_quota=True,user_id='eb6e3eed299345caa17ef810b193188a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Creating volume 0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:17 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:17 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 1073741824 Sep 28 17:25:17 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:17 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 1073741824" returned: 0 in 0.498s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:17 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:17 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:17 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.337s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a8ef8d-3aee-47ff-b56b-985bf372879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a7b95c3-ff9a-4710-80d4-0122976d5350', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080debe1-945f-4c94-a393-0c2bf40c179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Volume volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 (0a7b95c3-ff9a-4710-80d4-0122976d5350): created successfully Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080debe1-945f-4c94-a393-0c2bf40c179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Flow 'volume_create_manager' (046b3ea4-358d-4cf6-9d16-bbecf39366f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d08333bf-20c2-4d84-a88a-ceddb0ee7eed tempest-SnapshotDependencyTests-2037421681 None] Created volume successfully. Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Creating offline snapshot bbb06d86-bda8-4967-8f3f-0a74a93f5cec of volume 0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4fb3c-9677-48f9-9f24-f67f863af3e2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:19 devstack sudo[105454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:19 devstack sudo[105454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:19 devstack sudo[105454]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:19 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec 1G Sep 28 17:25:19 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec 1G" returned: 0 in 0.455s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:20 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec is being set with open permissions: ugo+rw Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:20 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:20 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.256s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:20 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info Sep 28 17:25:20 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:21 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info" returned: 0 in 0.278s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:21 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info is being set with open permissions: ugo+rw Sep 28 17:25:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:21 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info Sep 28 17:25:21 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:21 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.info" returned: 0 in 0.280s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.084s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9c48702d-2c00-4416-87c9-c9aa10cfa201 tempest-SnapshotDependencyTests-2037421681 None] Create snapshot completed successfully Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Flow 'volume_create_manager' (4736e411-2957-48e9-92b1-2dfee4983463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92207d5c-48b7-4b69-821a-9ff4be58a80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92207d5c-48b7-4b69-821a-9ff4be58a80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf7ea58c-c732-4a4a-8880-f7caae8dde58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e08a55af5f4e99b581d72d0d1c4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbb06d86-bda8-4967-8f3f-0a74a93f5cec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:23Z,use_quota=True,user_id='eb6e3eed299345caa17ef810b193188a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae1a5bc-ee3b-4010-b4fc-adf003c9200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aae1a5bc-ee3b-4010-b4fc-adf003c9200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c67e262-0587-4e0d-8d2a-1c62930ce182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c67e262-0587-4e0d-8d2a-1c62930ce182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf7ea58c-c732-4a4a-8880-f7caae8dde58', 'volume_name': 'volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58', 'volume_size': 1, 'snapshot_id': 'bbb06d86-bda8-4967-8f3f-0a74a93f5cec'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bd1e45-cbe4-4255-bbfe-24fb8ecdecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9bd1e45-cbe4-4255-bbfe-24fb8ecdecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8637419c-f8d9-4507-b1d5-f3b6ea6091bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Volume bf7ea58c-c732-4a4a-8880-f7caae8dde58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58', 'volume_size': 1, 'snapshot_id': 'bbb06d86-bda8-4967-8f3f-0a74a93f5cec'} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-bf7ea58c-c732-4a4a-8880-f7caae8dde58" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-bf7ea58c-c732-4a4a-8880-f7caae8dde58" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Creating volume bf7ea58c-c732-4a4a-8880-f7caae8dde58 from snapshot bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] snapshot: bbb06d86-bda8-4967-8f3f-0a74a93f5cec, volume: bf7ea58c-c732-4a4a-8880-f7caae8dde58, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eafcc9f-3865-44dc-aeef-a76b55a44314]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:23 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:23 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.379s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a7b95c3-ff9a-4710-80d4-0122976d5350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822a3c9-c40a-4508-a5cf-1e2722df00a0]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:23 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:23 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:24 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.378s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:25:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:25:24 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:25:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:24 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 Sep 28 17:25:24 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:29 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58" returned: 0 in 5.869s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:29 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:25:29 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Converted 1024.00 MB image at 174.42 MB/s Sep 28 17:25:29 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 is being set with open permissions: ugo+rw Sep 28 17:25:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:29 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 Sep 28 17:25:29 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:30 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58" returned: 0 in 0.267s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" released by "_copy_volume_from_snapshot" :: held 6.978s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-bf7ea58c-c732-4a4a-8880-f7caae8dde58" released by "_create_volume_from_snapshot" :: held 7.045s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.063s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8637419c-f8d9-4507-b1d5-f3b6ea6091bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58', 'volume_size': 1, 'snapshot_id': 'bbb06d86-bda8-4967-8f3f-0a74a93f5cec'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d8e58d-a650-4500-aa17-11285380ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Volume volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 (bf7ea58c-c732-4a4a-8880-f7caae8dde58): created successfully Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65d8e58d-a650-4500-aa17-11285380ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Flow 'volume_create_manager' (4736e411-2957-48e9-92b1-2dfee4983463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dc7c1f68-98e3-4eff-a703-c04a0886fe7b tempest-SnapshotDependencyTests-2037421681 None] Created volume successfully. Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Deleting offline snapshot bbb06d86-bda8-4967-8f3f-0a74a93f5cec of volume 0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] snapshot_file for this snap is: volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd2ea7a-afc7-4ca1-ba09-ce39b97d8432]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:31 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.375s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a7b95c3-ff9a-4710-80d4-0122976d5350(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6334eac1-ddc3-46cc-9538-90088ad96dcb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:31 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:31 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.545s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:31 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:31 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.356s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:32 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec Sep 28 17:25:32 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:32 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350.bbb06d86-bda8-4967-8f3f-0a74a93f5cec" returned: 0 in 0.281s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bbb06d86-bda8-4967-8f3f-0a74a93f5cec" released by "_delete_snapshot" :: held 1.667s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" released by "delete_snapshot" :: held 1.692s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Created reservations ['c263c3dd-ebcf-4540-9242-f073d49fb555', '2c7615fd-c449-4cef-970b-e03bd0285c80', 'ac85fff4-18dc-4337-8ae8-02ac0f9a177c', '5c525687-1578-4022-b1c3-485e2c82212e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Delete snapshot completed successfully. Sep 28 17:25:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-db175651-4157-40be-b708-3eb4171bf376 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-bbb06d86-bda8-4967-8f3f-0a74a93f5cec-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-0a7b95c3-ff9a-4710-80d4-0122976d5350-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-0a7b95c3-ff9a-4710-80d4-0122976d5350-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f116e2c-6062-4059-b40a-2b9cebace9ae]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:33 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.391s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350 Sep 28 17:25:33 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:33 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a7b95c3-ff9a-4710-80d4-0122976d5350" returned: 0 in 0.257s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-0a7b95c3-ff9a-4710-80d4-0122976d5350" released by "delete_volume" :: held 0.722s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Created reservations ['619b1c14-0809-4450-81ce-fe528bda2d24', '8be79bc5-5ea0-4d52-aba6-6a251a1081d4', 'f1238f72-8ea5-43c0-8c68-2ef19b12db69', 'e803dd4a-3422-4e91-94ad-be156e6fba77'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:33 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:25:33 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-bf7ea58c-c732-4a4a-8880-f7caae8dde58-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:34 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.261s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Deleted volume successfully. Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-bf7ea58c-c732-4a4a-8880-f7caae8dde58-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c8e635fe-589b-496c-814c-fddbc1eff7e8 tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-0a7b95c3-ff9a-4710-80d4-0122976d5350-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" acquired by "delete_volume" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[357e087e-eacb-4757-a46c-fc83baab9dac]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:34 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 Sep 28 17:25:34 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:34 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:34 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58 Sep 28 17:25:34 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:34 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bf7ea58c-c732-4a4a-8880-f7caae8dde58" returned: 0 in 0.286s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-quobyte-bf7ea58c-c732-4a4a-8880-f7caae8dde58" released by "delete_volume" :: held 0.711s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Created reservations ['a3ca1309-43fd-463c-b449-11f911628354', 'a0809fc3-7dc4-4c76-90b5-80bc70a893b0', '3dff569b-dc88-4b88-b04c-ff5ed6843dcb', 'adff0ef0-e55a-4ec0-ae3c-3e81c7d4df9f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:35 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:25:35 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:35 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Deleted volume successfully. Sep 28 17:25:35 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-432dd05f-4472-4892-9efd-21fcca36b0da tempest-SnapshotDependencyTests-2037421681 None] Lock "cinder-bf7ea58c-c732-4a4a-8880-f7caae8dde58-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:44 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:25:44 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:44 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:25:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:25:45 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=34,cinder:SELECT=22,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:45 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=27,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (56c1cec6-6da0-4816-94fa-7ecbd8055f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c6c3ea-d592-4eb8-8487-efc470b0b701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c6c3ea-d592-4eb8-8487-efc470b0b701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503331498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72093ce6-43f2-4c3e-b329-06f0ee612901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:57Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d2633e-78ed-4c7d-897c-797dea358ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d2633e-78ed-4c7d-897c-797dea358ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caada310-017f-4fef-8f34-7694eb44f5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caada310-017f-4fef-8f34-7694eb44f5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72093ce6-43f2-4c3e-b329-06f0ee612901', 'volume_name': 'volume-72093ce6-43f2-4c3e-b329-06f0ee612901', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d66a5-a4e6-4e08-ac7e-79b7fa417605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06d66a5-a4e6-4e08-ac7e-79b7fa417605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f964b792-7fe3-427e-8061-d256a73b0be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:57 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Volume 72093ce6-43f2-4c3e-b329-06f0ee612901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72093ce6-43f2-4c3e-b329-06f0ee612901', 'volume_size': 1} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-503331498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72093ce6-43f2-4c3e-b329-06f0ee612901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:57Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Creating volume 72093ce6-43f2-4c3e-b329-06f0ee612901 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:57 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:57 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 1073741824 Sep 28 17:25:57 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (34e29bfc-d6f8-41fa-96b9-3f8672483898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3c46be-78e1-4cbe-a3b6-6c91cbaf7820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3c46be-78e1-4cbe-a3b6-6c91cbaf7820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343942552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b8813-2398-401a-80e7-b2a7c2633526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68927ee6-b77b-4044-b468-182a732df6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68927ee6-b77b-4044-b468-182a732df6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1e67cc-7f7f-4aeb-9107-a3ef04d1d585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1e67cc-7f7f-4aeb-9107-a3ef04d1d585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c77b8813-2398-401a-80e7-b2a7c2633526', 'volume_name': 'volume-c77b8813-2398-401a-80e7-b2a7c2633526', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b03a56-f9a5-4da2-bc61-de931371d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b03a56-f9a5-4da2-bc61-de931371d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a295d056-df03-447c-82b1-c2f67085e34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Volume c77b8813-2398-401a-80e7-b2a7c2633526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c77b8813-2398-401a-80e7-b2a7c2633526', 'volume_size': 1} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:58 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 1073741824" returned: 0 in 0.940s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (2530688c-3d05-4728-af61-dc30e7144e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d7a11f-49ea-477a-bee1-5cc67beb82ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d7a11f-49ea-477a-bee1-5cc67beb82ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573018764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c70b123-bce4-465f-a7bd-231c0b0af9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c70b123-bce4-465f-a7bd-231c0b0af9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f66a06-6b3b-4dbb-9357-dcf41742be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f66a06-6b3b-4dbb-9357-dcf41742be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87', 'volume_name': 'volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8339f93-dc17-4dc2-9e25-b9ca4fc6673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8339f93-dc17-4dc2-9e25-b9ca4fc6673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c35620c-74f7-4a32-a4ee-7b0d066e7928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume 8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87', 'volume_size': 1} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 Sep 28 17:25:58 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (8efb24d7-4462-41a4-b62a-2ff782800a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da22676-b495-43d3-97a4-3d74bd6b7214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da22676-b495-43d3-97a4-3d74bd6b7214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615202656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a91f22-b638-45a4-b4c3-1159ca4cdc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a83a9c-1e7f-4a2a-9aac-e96a24d7313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a83a9c-1e7f-4a2a-9aac-e96a24d7313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a91a55-e543-4801-9562-287fb276c24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a91a55-e543-4801-9562-287fb276c24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a91f22-b638-45a4-b4c3-1159ca4cdc6f', 'volume_name': 'volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18659d6-cde0-4ab2-8d54-1cb67f2d04e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18659d6-cde0-4ab2-8d54-1cb67f2d04e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15745e0-ee6d-482d-9956-153c03d5ccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Volume 07a91f22-b638-45a4-b4c3-1159ca4cdc6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f', 'volume_size': 1} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901" returned: 0 in 0.378s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343942552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c77b8813-2398-401a-80e7-b2a7c2633526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Creating volume c77b8813-2398-401a-80e7-b2a7c2633526 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f964b792-7fe3-427e-8061-d256a73b0be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72093ce6-43f2-4c3e-b329-06f0ee612901', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 1073741824 Sep 28 17:25:58 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6095dc0a-d492-4ff3-9400-1e6a6e773a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Volume volume-72093ce6-43f2-4c3e-b329-06f0ee612901 (72093ce6-43f2-4c3e-b329-06f0ee612901): created successfully Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6095dc0a-d492-4ff3-9400-1e6a6e773a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (56c1cec6-6da0-4816-94fa-7ecbd8055f51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:58 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fa33d0a5-571a-4b2f-8c8a-dad39968058b tempest-CreateVolumesFromImageTest-1096501478 None] Created volume successfully. Sep 28 17:25:58 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e141c633-73f1-4700-850b-9e9b2acdc2df tempest-ProjectAdminTests-1699300264 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.1520614624023, 'free_capacity_gb': 1775.1520614624023, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86842) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (f3da9124-1005-4640-83ca-aff0d948309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f654c31-9f55-4e83-a109-8774ae5087e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f654c31-9f55-4e83-a109-8774ae5087e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760965320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ae1021-8439-421b-98f8-7daa8b26866e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:59Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706fa4fc-98fe-4bdb-856b-65e6d211181f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (706fa4fc-98fe-4bdb-856b-65e6d211181f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36c081a-980a-44cd-8462-883bf8b52e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f36c081a-980a-44cd-8462-883bf8b52e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ae1021-8439-421b-98f8-7daa8b26866e', 'volume_name': 'volume-67ae1021-8439-421b-98f8-7daa8b26866e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c79fa75-a882-431e-9f2a-48020d68f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c79fa75-a882-431e-9f2a-48020d68f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e8d248-c50c-4aeb-8863-2ccc5a3efba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume 67ae1021-8439-421b-98f8-7daa8b26866e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ae1021-8439-421b-98f8-7daa8b26866e', 'volume_size': 1} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:59 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 1073741824" returned: 0 in 0.677s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:25:59 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 Sep 28 17:25:59 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (4f7a80d0-51b9-4eee-93c0-6ccef4076b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9b5de2-95f2-4ff1-b0b8-c4c6726b2419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9b5de2-95f2-4ff1-b0b8-c4c6726b2419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921235397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08116b46-87d0-47ac-86f1-c40c2b12fe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:00Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad41c184-965c-4465-8621-39551e0d9451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad41c184-965c-4465-8621-39551e0d9451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10646d26-15a0-4b8a-a893-b91080c2f2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10646d26-15a0-4b8a-a893-b91080c2f2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08116b46-87d0-47ac-86f1-c40c2b12fe9e', 'volume_name': 'volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecaff92-07bf-40e5-8563-9fe91e9499c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ecaff92-07bf-40e5-8563-9fe91e9499c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46864e3-8001-4744-ae5a-b9f7922bdcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:25:59 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume 08116b46-87d0-47ac-86f1-c40c2b12fe9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e', 'volume_size': 1} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:59 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526" returned: 0 in 0.441s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573018764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume 8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:25:59 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:25:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a295d056-df03-447c-82b1-c2f67085e34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c77b8813-2398-401a-80e7-b2a7c2633526', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:00 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 1073741824 Sep 28 17:26:00 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd292411-5c7b-4b70-a131-56d17716c4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:00 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Volume volume-c77b8813-2398-401a-80e7-b2a7c2633526 (c77b8813-2398-401a-80e7-b2a7c2633526): created successfully Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd292411-5c7b-4b70-a131-56d17716c4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (34e29bfc-d6f8-41fa-96b9-3f8672483898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ba267fe0-1f71-41cb-bc4a-f10d6d9cb512 tempest-CreateVolumesFromImageTest-1096501478 None] Created volume successfully. Sep 28 17:26:00 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 1073741824" returned: 0 in 0.611s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:00 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 Sep 28 17:26:00 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:00 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" returned: 0 in 0.337s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-615202656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a91f22-b638-45a4-b4c3-1159ca4cdc6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:58Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Creating volume 07a91f22-b638-45a4-b4c3-1159ca4cdc6f {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:00 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:01 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c35620c-74f7-4a32-a4ee-7b0d066e7928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:01 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f 1073741824 Sep 28 17:26:01 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1d467-c1fb-4e22-9936-555e35261dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:01 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 (8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87): created successfully Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f1d467-c1fb-4e22-9936-555e35261dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (2530688c-3d05-4728-af61-dc30e7144e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:01 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4d352d3b-d080-4169-bd8b-bd4f39fda256 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:01 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f 1073741824" returned: 0 in 0.772s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:01 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f Sep 28 17:26:01 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (5d49dbc4-1a7b-459a-8663-4a90a3805a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f0c36-4bd0-4bb9-8db8-4a615f45625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3f0c36-4bd0-4bb9-8db8-4a615f45625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967673930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0a8968-b895-46f7-b0cc-f9832ae34e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:02Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71562f5b-19b1-40b3-a0b0-c420e3d13841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71562f5b-19b1-40b3-a0b0-c420e3d13841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d001bd14-69e7-4501-88f7-c442dd14d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d001bd14-69e7-4501-88f7-c442dd14d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee0a8968-b895-46f7-b0cc-f9832ae34e14', 'volume_name': 'volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3318d828-b807-4b60-8254-2594993629ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3318d828-b807-4b60-8254-2594993629ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc4c2c8-1473-4d09-bb77-427da5244521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume ee0a8968-b895-46f7-b0cc-f9832ae34e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14', 'volume_size': 1} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" returned: 0 in 0.536s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1760965320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ae1021-8439-421b-98f8-7daa8b26866e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:25:59Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Creating volume 67ae1021-8439-421b-98f8-7daa8b26866e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:02 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15745e0-ee6d-482d-9956-153c03d5ccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d481c9b-424e-407e-9f65-2bef66a4fe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e 1073741824 Sep 28 17:26:02 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Volume volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f (07a91f22-b638-45a4-b4c3-1159ca4cdc6f): created successfully Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d481c9b-424e-407e-9f65-2bef66a4fe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (8efb24d7-4462-41a4-b62a-2ff782800a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:02 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-99567e57-83ca-466e-913a-280864df99da tempest-CreateVolumesFromImageTest-1096501478 None] Created volume successfully. Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (b8d44f5d-c054-4435-bc9d-3221edc96d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aee053-1823-4a8a-8c34-6653cd5f888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aee053-1823-4a8a-8c34-6653cd5f888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1085837823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409b3e8a-397d-42ca-9a34-6ca80f988cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e4bb06-d6a9-49bb-a8f2-14d957a31bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96e4bb06-d6a9-49bb-a8f2-14d957a31bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11647e1-edbc-46c7-ae63-949db094003f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b11647e1-edbc-46c7-ae63-949db094003f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409b3e8a-397d-42ca-9a34-6ca80f988cdf', 'volume_name': 'volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868af118-a327-4d32-8bca-f1a784d69720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868af118-a327-4d32-8bca-f1a784d69720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5889a53d-fb33-438b-a802-ba029b936ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume 409b3e8a-397d-42ca-9a34-6ca80f988cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf', 'volume_size': 1} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:03 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e 1073741824" returned: 0 in 0.821s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e Sep 28 17:26:03 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (d2bc0a62-ec35-4999-9890-cc52c5a68618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e175e957-8ceb-4464-8faa-0cc6bb41c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e175e957-8ceb-4464-8faa-0cc6bb41c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289027934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab4a5bd-3233-4a94-bd0d-f050a5788a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60738cc7-aefe-4990-baa3-8061a5a5bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60738cc7-aefe-4990-baa3-8061a5a5bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb0e9a3-e250-4723-af82-653d4d9a2344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb0e9a3-e250-4723-af82-653d4d9a2344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab4a5bd-3233-4a94-bd0d-f050a5788a06', 'volume_name': 'volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a9929-2aa3-44fd-a1ed-c2a836a7863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6a9929-2aa3-44fd-a1ed-c2a836a7863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bc01b5-391a-4787-8e7c-fde46159f119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume 8ab4a5bd-3233-4a94-bd0d-f050a5788a06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06', 'volume_size': 1} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:03 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e" returned: 0 in 0.327s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.739s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921235397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08116b46-87d0-47ac-86f1-c40c2b12fe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988f6da9daf44f3884e4641c5784cdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:00Z,use_quota=True,user_id='e00a0dae597a477bbb1f01eabe7ab5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Creating volume 08116b46-87d0-47ac-86f1-c40c2b12fe9e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:03 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:03 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e 1073741824 Sep 28 17:26:03 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e8d248-c50c-4aeb-8863-2ccc5a3efba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ae1021-8439-421b-98f8-7daa8b26866e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09502efa-b09b-42a9-8331-573864c8c503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume volume-67ae1021-8439-421b-98f8-7daa8b26866e (67ae1021-8439-421b-98f8-7daa8b26866e): created successfully Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09502efa-b09b-42a9-8331-573864c8c503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (f3da9124-1005-4640-83ca-aff0d948309a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-29b955d5-5d3b-42da-a45a-2baa8cab8aa6 tempest-CreateVolumesFromImageTest-1096501478 None] Created volume successfully. Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (557cf6cc-b851-4c76-a5db-3bda15cd62a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c09b0f-0a86-4863-a821-554dfa7fc7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c09b0f-0a86-4863-a821-554dfa7fc7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473909922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a8380-3f86-4c44-8fbd-c27cfbf13698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:04Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce68e80-13ae-4211-89c4-ae150f2167d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce68e80-13ae-4211-89c4-ae150f2167d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68141c0e-4fa4-4f0f-829d-45a3cdf9bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68141c0e-4fa4-4f0f-829d-45a3cdf9bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b1a8380-3f86-4c44-8fbd-c27cfbf13698', 'volume_name': 'volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a5644e-2fea-4365-9876-4e1316851984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a5644e-2fea-4365-9876-4e1316851984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9b9841-8edc-4507-be0e-0e5ba0894029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume 5b1a8380-3f86-4c44-8fbd-c27cfbf13698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698', 'volume_size': 1} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Flow 'volume_create_manager' (9973cbf4-b5b1-43c2-96ec-5390a9d4dbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:04 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f914d35-8897-4a8e-ba4f-9d05fdec2e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e 1073741824" returned: 0 in 0.773s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f914d35-8897-4a8e-ba4f-9d05fdec2e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c671a-0a72-4953-9de1-8cd001176f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7b469c0f9b489090624e3380898615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:04Z,use_quota=True,user_id='b844b537376d486c9cf887540b2a25b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347de649-680c-49fb-a2d2-147c527f64b7),volume_type_id=347de649-680c-49fb-a2d2-147c527f64b7)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3f07f2-c3df-4ac9-b4f4-06862dd12fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3f07f2-c3df-4ac9-b4f4-06862dd12fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d8c19-3ffc-40f3-b3e0-a683f4db977d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e Sep 28 17:26:04 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (a0b6ce94-5089-4659-895e-addc33df700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb43d4-5e25-41b1-8fe9-5ddf483a4e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23eb43d4-5e25-41b1-8fe9-5ddf483a4e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-455418554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63df9c3a-3f89-406c-a790-cdb17b64f1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:05Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fc6ffd-8a87-40f8-8684-ea943836a0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fc6ffd-8a87-40f8-8684-ea943836a0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f0f31d-9301-496c-afc3-522a76b90016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f0f31d-9301-496c-afc3-522a76b90016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63df9c3a-3f89-406c-a790-cdb17b64f1d3', 'volume_name': 'volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b13d40b-21e7-43d5-b333-41e88cc51914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b13d40b-21e7-43d5-b333-41e88cc51914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bea865-16e4-4614-a509-6357609ad62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume 63df9c3a-3f89-406c-a790-cdb17b64f1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3', 'volume_size': 1} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.502s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1967673930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0a8968-b895-46f7-b0cc-f9832ae34e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:02Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume ee0a8968-b895-46f7-b0cc-f9832ae34e14 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:04 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:04 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 1073741824 Sep 28 17:26:04 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46864e3-8001-4744-ae5a-b9f7922bdcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ea3e37-be88-4d9e-bde5-4d4c29c977f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:04 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Volume volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e (08116b46-87d0-47ac-86f1-c40c2b12fe9e): created successfully Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ea3e37-be88-4d9e-bde5-4d4c29c977f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Flow 'volume_create_manager' (4f7a80d0-51b9-4eee-93c0-6ccef4076b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:04 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6be64db5-8f63-4b37-9894-2dd570b80ea6 tempest-CreateVolumesFromImageTest-1096501478 None] Created volume successfully. Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78d8c19-3ffc-40f3-b3e0-a683f4db977d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '566c671a-0a72-4953-9de1-8cd001176f8b', 'volume_name': 'volume-566c671a-0a72-4953-9de1-8cd001176f8b', 'volume_size': 1, 'image_id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e39d94c0992700b48e7cd9fb756ed786', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a7b469c0f9b489090624e3380898615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51eb53c1ee232c3952490d3fbe47d6fb9f31ffd1b59bdd49cc5e00cb65710057a86c066260e204596573422c1b2a582902d0684bd9ddbc07d4212cc1820ec5f9', 'id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd2cdab5-aafb-4eec-bf29-e47279431a55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5379ce38-95c8-4857-bfcb-c80da1640b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5379ce38-95c8-4857-bfcb-c80da1640b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587987e-1f69-4023-9270-6201ca753f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Volume 566c671a-0a72-4953-9de1-8cd001176f8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-566c671a-0a72-4953-9de1-8cd001176f8b', 'volume_size': 1, 'image_id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e39d94c0992700b48e7cd9fb756ed786', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a7b469c0f9b489090624e3380898615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51eb53c1ee232c3952490d3fbe47d6fb9f31ffd1b59bdd49cc5e00cb65710057a86c066260e204596573422c1b2a582902d0684bd9ddbc07d4212cc1820ec5f9', 'id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd2cdab5-aafb-4eec-bf29-e47279431a55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Trying to clone 566c671a-0a72-4953-9de1-8cd001176f8b from image cd2cdab5-aafb-4eec-bf29-e47279431a55 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (ffed2c9c-0189-4a9e-ab6d-240f33167f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622f44fc-3f4e-4500-87b2-98b900a25cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622f44fc-3f4e-4500-87b2-98b900a25cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867104667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d2df1b-007b-443f-88cd-172405971bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:05Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dc976a-d6c4-4660-ab83-982f85c7f895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52dc976a-d6c4-4660-ab83-982f85c7f895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93bdc56-990a-430d-a6a6-daf902588d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93bdc56-990a-430d-a6a6-daf902588d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d2df1b-007b-443f-88cd-172405971bb6', 'volume_name': 'volume-35d2df1b-007b-443f-88cd-172405971bb6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd05fb-89d6-4b1a-a952-5e806afdb81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afd05fb-89d6-4b1a-a952-5e806afdb81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf54a56-ce23-425a-a76f-75c65f5adeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Volume 35d2df1b-007b-443f-88cd-172405971bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d2df1b-007b-443f-88cd-172405971bb6', 'volume_size': 1} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-08116b46-87d0-47ac-86f1-c40c2b12fe9e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:26:05 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-08116b46-87d0-47ac-86f1-c40c2b12fe9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-quobyte-08116b46-87d0-47ac-86f1-c40c2b12fe9e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf75082-58cd-4760-8b37-0fe98c2bb1b0]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-08116b46-87d0-47ac-86f1-c40c2b12fe9e" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb33649-ef00-468e-b8e9-158b4f29dc50]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 1073741824" returned: 0 in 0.679s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:05 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e Sep 28 17:26:05 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 Sep 28 17:26:05 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:05 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.894s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1085837823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409b3e8a-397d-42ca-9a34-6ca80f988cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume 409b3e8a-397d-42ca-9a34-6ca80f988cdf {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:05 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e" returned: 0 in 0.492s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:05 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf 1073741824 Sep 28 17:26:06 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc4c2c8-1473-4d09-bb77-427da5244521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297e0b64-7567-4b87-b714-ca015f9982d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:06 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e Sep 28 17:26:06 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:06 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 (ee0a8968-b895-46f7-b0cc-f9832ae34e14): created successfully Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297e0b64-7567-4b87-b714-ca015f9982d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (5d49dbc4-1a7b-459a-8663-4a90a3805a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-03b5eb69-90bf-455a-ac17-79a9bfafd791 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:06 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Temporary image cd2cdab5-aafb-4eec-bf29-e47279431a55 is fetched for user b844b537376d486c9cf887540b2a25b4. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-08116b46-87d0-47ac-86f1-c40c2b12fe9e" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-08116b46-87d0-47ac-86f1-c40c2b12fe9e" released by "delete_volume" :: held 0.886s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[42701cde-7cca-4043-8c57-3840d554874b]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Created reservations ['b8ee7ef7-67f4-4813-a090-f4b5d88c9e4b', '84e6c5d9-617e-4be2-99bc-a5167a686a81', 'fca87f6e-83a5-4b4d-9f9a-018ea5b1bb1f', '6fbfa3b9-5cb8-4f39-a294-79c69eaf6f2f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:06 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:06 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf 1073741824" returned: 0 in 0.604s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf Sep 28 17:26:06 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.313s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Deleted volume successfully. Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c9c8ae51-f0c6-412f-9c47-308050afaaba tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-08116b46-87d0-47ac-86f1-c40c2b12fe9e-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:06 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf" returned: 0 in 0.306s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.371s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-289027934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab4a5bd-3233-4a94-bd0d-f050a5788a06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:03Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume 8ab4a5bd-3233-4a94-bd0d-f050a5788a06 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:06 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:06 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:06 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5889a53d-fb33-438b-a802-ba029b936ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:06 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 1073741824 Sep 28 17:26:06 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8100ec-aa7e-4fca-92fa-f3bfdd7f4a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf (409b3e8a-397d-42ca-9a34-6ca80f988cdf): created successfully Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a8100ec-aa7e-4fca-92fa-f3bfdd7f4a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (b8d44f5d-c054-4435-bc9d-3221edc96d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3b6fe818-e03d-41a4-8321-e0422c448b35 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:07 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:07 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 1073741824" returned: 0 in 0.484s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 Sep 28 17:26:07 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-67ae1021-8439-421b-98f8-7daa8b26866e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-67ae1021-8439-421b-98f8-7daa8b26866e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-quobyte-67ae1021-8439-421b-98f8-7daa8b26866e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-67ae1021-8439-421b-98f8-7daa8b26866e" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b16107-9015-4630-bb27-6829a7f62289]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.583s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473909922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b1a8380-3f86-4c44-8fbd-c27cfbf13698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:04Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume 5b1a8380-3f86-4c44-8fbd-c27cfbf13698 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:07 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3bc01b5-391a-4787-8e7c-fde46159f119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:07 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 1073741824 Sep 28 17:26:07 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5dc24d-17fc-49d4-91fd-91b717b42c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 (8ab4a5bd-3233-4a94-bd0d-f050a5788a06): created successfully Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b5dc24d-17fc-49d4-91fd-91b717b42c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (d2bc0a62-ec35-4999-9890-cc52c5a68618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dae33b5a-e5e8-4f7e-bec5-2f24c40721ba tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:07 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e Sep 28 17:26:07 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e" returned: 0 in 0.409s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e Sep 28 17:26:08 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 1073741824" returned: 0 in 0.524s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 Sep 28 17:26:08 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67ae1021-8439-421b-98f8-7daa8b26866e" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-67ae1021-8439-421b-98f8-7daa8b26866e" released by "delete_volume" :: held 0.770s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Created reservations ['74def0ea-308c-4bb7-9c9f-d26c3bb31615', '75243bb5-2d9f-46b4-a471-ded083e5d7c5', 'b2a82ebc-1716-4d11-9fd5-dd09f098aa7c', 'f55a4cb0-cf64-466e-aac5-064ee4c27556'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:08 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.743s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-455418554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63df9c3a-3f89-406c-a790-cdb17b64f1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bc0b561acc4c75a9ef8489b7933d93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:05Z,use_quota=True,user_id='4c4e68f7b89a4c0e866f58729c896b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Creating volume 63df9c3a-3f89-406c-a790-cdb17b64f1d3 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:08 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:08 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:08 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9b9841-8edc-4507-be0e-0e5ba0894029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:08 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 1073741824 Sep 28 17:26:08 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668f7acc-bd44-40c1-a6c4-b63ed3dafcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:08 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 (5b1a8380-3f86-4c44-8fbd-c27cfbf13698): created successfully Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668f7acc-bd44-40c1-a6c4-b63ed3dafcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (557cf6cc-b851-4c76-a5db-3bda15cd62a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-243885bd-bc4d-4913-ae13-7608e274393d tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-07a91f22-b638-45a4-b4c3-1159ca4cdc6f-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-07a91f22-b638-45a4-b4c3-1159ca4cdc6f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.273s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-quobyte-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:08 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Deleted volume successfully. Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b78c9b49-4d6d-4f54-830f-c7bcbcbc0288 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-67ae1021-8439-421b-98f8-7daa8b26866e-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8452d273-6e5c-40ab-b1e2-42ae84c20cc7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f Sep 28 17:26:09 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 1073741824" returned: 0 in 0.515s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 Sep 28 17:26:09 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f Sep 28 17:26:09 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3" returned: 0 in 0.253s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.100s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867104667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d2df1b-007b-443f-88cd-172405971bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:05Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Creating volume 35d2df1b-007b-443f-88cd-172405971bb6 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:09 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 1073741824 Sep 28 17:26:09 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bea865-16e4-4614-a509-6357609ad62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d50e81e-3cb1-4dd6-86f7-c53f4f451905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:09 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Volume volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 (63df9c3a-3f89-406c-a790-cdb17b64f1d3): created successfully Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d50e81e-3cb1-4dd6-86f7-c53f4f451905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Flow 'volume_create_manager' (a0b6ce94-5089-4659-895e-addc33df700e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:09 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5b1dd18e-0597-4cde-b55e-e32f46602f81 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created volume successfully. Sep 28 17:26:09 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" returned: 0 in 0.311s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-07a91f22-b638-45a4-b4c3-1159ca4cdc6f" released by "delete_volume" :: held 0.773s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Created reservations ['89bfa142-71bf-4d0b-b405-692c34469b3b', '4186298f-6e95-41c7-bbfc-1774245d5f30', '6a8f870f-1d17-4f2c-be56-138c0ae6111d', 'e8b05ddb-d8f1-439c-9685-d2069e957262'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:09 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:09 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-c77b8813-2398-401a-80e7-b2a7c2633526-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:10 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 1073741824" returned: 0 in 0.559s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-c77b8813-2398-401a-80e7-b2a7c2633526-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-quobyte-c77b8813-2398-401a-80e7-b2a7c2633526" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:10 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 Sep 28 17:26:10 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.286s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-c77b8813-2398-401a-80e7-b2a7c2633526" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Deleted volume successfully. Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba507090-aca1-4d6f-b3ac-b0d4bec2c95e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2af33e55-e0ca-4b17-88ea-765bfb8dd468 tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-07a91f22-b638-45a4-b4c3-1159ca4cdc6f-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 Sep 28 17:26:10 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-63df9c3a-3f89-406c-a790-cdb17b64f1d3-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-63df9c3a-3f89-406c-a790-cdb17b64f1d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:10 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6" returned: 0 in 0.298s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.160s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c671a-0a72-4953-9de1-8cd001176f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a7b469c0f9b489090624e3380898615',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:04Z,use_quota=True,user_id='b844b537376d486c9cf887540b2a25b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(347de649-680c-49fb-a2d2-147c527f64b7),volume_type_id=347de649-680c-49fb-a2d2-147c527f64b7)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Creating volume 566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:10 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-63df9c3a-3f89-406c-a790-cdb17b64f1d3" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdf54a56-ce23-425a-a76f-75c65f5adeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d2df1b-007b-443f-88cd-172405971bb6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85f22bd-ee8e-4a51-a623-8f823b11e0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:10 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1073741824 Sep 28 17:26:10 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-63df9c3a-3f89-406c-a790-cdb17b64f1d3" acquired by "delete_volume" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Volume volume-35d2df1b-007b-443f-88cd-172405971bb6 (35d2df1b-007b-443f-88cd-172405971bb6): created successfully Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85f22bd-ee8e-4a51-a623-8f823b11e0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (ffed2c9c-0189-4a9e-ab6d-240f33167f54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daaafe0-dc57-48a7-adde-cced5f730f4b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-01b7bdb0-e805-420a-ad87-e332bedafe39 tempest-ProjectReaderTests-1615684561 None] Created volume successfully. Sep 28 17:26:10 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526" returned: 0 in 0.451s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 Sep 28 17:26:10 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526 Sep 28 17:26:10 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c77b8813-2398-401a-80e7-b2a7c2633526" returned: 0 in 0.280s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1073741824" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-c77b8813-2398-401a-80e7-b2a7c2633526" released by "delete_volume" :: held 0.784s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3 Sep 28 17:26:10 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:10 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Created reservations ['e4cb3333-03d3-4708-a2a1-8064d767aa8b', 'd8559ada-748e-43a0-8f28-d7dfd02ce9c0', 'fe9728d5-5f2c-4119-8029-043949c4af1d', '2807bdb1-3d55-4acc-99d3-87f07178f1ce'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:10 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b Sep 28 17:26:10 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:11 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-63df9c3a-3f89-406c-a790-cdb17b64f1d3" returned: 0 in 0.277s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-63df9c3a-3f89-406c-a790-cdb17b64f1d3" released by "delete_volume" :: held 0.755s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-72093ce6-43f2-4c3e-b329-06f0ee612901-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-72093ce6-43f2-4c3e-b329-06f0ee612901-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Attempting download of cd2cdab5-aafb-4eec-bf29-e47279431a55 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}])) to volume 566c671a-0a72-4953-9de1-8cd001176f8b. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['0b46aef5-288e-4e73-afa1-b7d22fc314d4', '64c1308f-4802-4249-a41c-13ed2af4a43f', 'd3f86030-2ba1-407e-a476-8bdce95f0cb4', '10a21530-75b7-4dd3-b680-38076292c780'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "cinder-quobyte-72093ce6-43f2-4c3e-b329-06f0ee612901" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-72093ce6-43f2-4c3e-b329-06f0ee612901" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.327s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Deleted volume successfully. Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[678de24e-6e3d-42e3-bf5f-73895a141073]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffa757a-a45b-40c6-affc-9d1dd5dfa647]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-43de1e30-ae07-4183-9010-d31aa656f90f tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-c77b8813-2398-401a-80e7-b2a7c2633526-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:11 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-5b1a8380-3f86-4c44-8fbd-c27cfbf13698-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-5b1a8380-3f86-4c44-8fbd-c27cfbf13698-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:11 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" acquired by "delete_volume" :: waited 0.056s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:11 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 Sep 28 17:26:11 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:11 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a87645-bae5-44d6-afe0-26a8b2e46114]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:11 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 Sep 28 17:26:11 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:11 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu" returned: 0 in 0.614s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.531s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-35d2df1b-007b-443f-88cd-172405971bb6-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:12 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu Sep 28 17:26:12 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-35d2df1b-007b-443f-88cd-172405971bb6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b05a8b55-ae14-44d6-b181-2fe2c2537abc tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-63df9c3a-3f89-406c-a790-cdb17b64f1d3-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-quobyte-35d2df1b-007b-443f-88cd-172405971bb6" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-35d2df1b-007b-443f-88cd-172405971bb6" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e8569f-5200-43ec-8b5e-0ec7b8c56807]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901" returned: 0 in 0.904s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" returned: 0 in 0.466s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901 Sep 28 17:26:12 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698 Sep 28 17:26:12 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu" returned: 1 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cd2cdab5-aafb-4eec-bf29-e47279431a55__eo7f_hu' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840ebac-3973-45cc-8aed-933ec7ce8f17]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 Sep 28 17:26:12 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:12 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-72093ce6-43f2-4c3e-b329-06f0ee612901" returned: 0 in 0.333s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-quobyte-72093ce6-43f2-4c3e-b329-06f0ee612901" released by "delete_volume" :: held 1.317s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:12 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" returned: 0 in 0.338s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-5b1a8380-3f86-4c44-8fbd-c27cfbf13698" released by "delete_volume" :: held 0.902s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Created reservations ['3d9713d5-b97f-4e29-b23e-147b0f92c51f', 'edd4dd55-99ee-4646-a266-f6536cdc8236', '51778e24-1d7c-4ad3-8245-967d6dbfe851', 'f86b304c-d5ea-4633-a728-5a9b0889e72b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['8d4b516b-cb49-4417-96aa-9046c9559941', '372c3ea0-3bf2-4023-b8b1-a97136d947f8', '65b703d9-4654-4adc-a071-2db2fcce3793', '273f5bf5-1aff-499d-b7db-8d0e2142a076'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:12 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6" returned: 0 in 0.590s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6 Sep 28 17:26:12 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:12 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:12 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD Sep 28 17:26:12 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:13 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-35d2df1b-007b-443f-88cd-172405971bb6" returned: 0 in 0.318s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-35d2df1b-007b-443f-88cd-172405971bb6" released by "delete_volume" :: held 0.953s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD" returned: 1 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] cd2cdab5-aafb-4eec-bf29-e47279431a55 was raw, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.298s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:13 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b Sep 28 17:26:13 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Created reservations ['82ae5583-955e-4b96-8c4a-3eded6d56609', '1b951937-56a3-4ffc-b530-f36051f8e96d', '2d521f9f-27f2-48e9-8b59-15f72e7aaa35', '2a040863-0022-445f-bea0-e09f586aa91b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Deleted volume successfully. Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-81386220-4781-48bc-a312-dc7a79364374 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-5b1a8380-3f86-4c44-8fbd-c27cfbf13698-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f111cbe-0988-4c8e-8735-f505b58cd24b tempest-CreateVolumesFromImageTest-1096501478 None] Lock "cinder-72093ce6-43f2-4c3e-b329-06f0ee612901-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:13 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Deleted volume successfully. Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-30e91a38-9b6f-41f6-849d-66941d3be460 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-35d2df1b-007b-443f-88cd-172405971bb6-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-8ab4a5bd-3233-4a94-bd0d-f050a5788a06-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:13 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b" returned: 0 in 0.607s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cd2cdab5-aafb-4eec-bf29-e47279431a55_hat4zfpydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:13 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-8ab4a5bd-3233-4a94-bd0d-f050a5788a06-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:13 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1G Sep 28 17:26:13 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795ee12-01b1-4b6c-a8a2-ccacbc0f69f7]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:14 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 Sep 28 17:26:14 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:14 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b 1G" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Downloaded image cd2cdab5-aafb-4eec-bf29-e47279431a55 ((None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}])) to volume 566c671a-0a72-4953-9de1-8cd001176f8b successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Temporary image cd2cdab5-aafb-4eec-bf29-e47279431a55 for user b844b537376d486c9cf887540b2a25b4 is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Marking volume 566c671a-0a72-4953-9de1-8cd001176f8b as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Copying metadata from image cd2cdab5-aafb-4eec-bf29-e47279431a55 to 566c671a-0a72-4953-9de1-8cd001176f8b. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Creating volume glance metadata for volume 566c671a-0a72-4953-9de1-8cd001176f8b backed by image cd2cdab5-aafb-4eec-bf29-e47279431a55 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e39d94c0992700b48e7cd9fb756ed786', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587987e-1f69-4023-9270-6201ca753f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566c671a-0a72-4953-9de1-8cd001176f8b', 'volume_size': 1, 'image_id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cd2cdab5-aafb-4eec-bf29-e47279431a55', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e39d94c0992700b48e7cd9fb756ed786', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a7b469c0f9b489090624e3380898615', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '51eb53c1ee232c3952490d3fbe47d6fb9f31ffd1b59bdd49cc5e00cb65710057a86c066260e204596573422c1b2a582902d0684bd9ddbc07d4212cc1820ec5f9', 'id': 'cd2cdab5-aafb-4eec-bf29-e47279431a55', 'created_at': datetime.datetime(2026, 9, 28, 15, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 26, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cd2cdab5-aafb-4eec-bf29-e47279431a55/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11ab77-c86b-494a-8f03-c3c7c7e2f967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Volume volume-566c671a-0a72-4953-9de1-8cd001176f8b (566c671a-0a72-4953-9de1-8cd001176f8b): created successfully Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c11ab77-c86b-494a-8f03-c3c7c7e2f967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Flow 'volume_create_manager' (9973cbf4-b5b1-43c2-96ec-5390a9d4dbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:14 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-173993f4-021c-4e34-beca-9e3283cf4315 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Created volume successfully. Sep 28 17:26:14 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:14 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06 Sep 28 17:26:14 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:14 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" returned: 0 in 0.330s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-8ab4a5bd-3233-4a94-bd0d-f050a5788a06" released by "delete_volume" :: held 0.866s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:14 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['ca5da17b-a5a5-438a-9048-abb1adc3a29e', 'c1b44bdc-63cc-4399-9c38-e2b41c751827', '99f72066-ed3c-4fa3-a364-277f7e874127', 'efdc371e-a5fd-48b9-9026-f10e5e917728'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:15 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (e087c941-42f4-4c4f-8213-47875e452dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a0a07-7699-4b3c-a96d-0cb5956965f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Acquiring lock "cinder-566c671a-0a72-4953-9de1-8cd001176f8b-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-409b3e8a-397d-42ca-9a34-6ca80f988cdf-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5a0a07-7699-4b3c-a96d-0cb5956965f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055739072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172f4ec-eb47-4a0c-9214-1ab6b0d8c343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:15Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe82b526-087e-48c3-8a28-d70ecaaf5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe82b526-087e-48c3-8a28-d70ecaaf5395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bea16a-bbac-49c2-af5a-15dd197ce4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bea16a-bbac-49c2-af5a-15dd197ce4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3172f4ec-eb47-4a0c-9214-1ab6b0d8c343', 'volume_name': 'volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2884e-5cb2-420f-ae29-b9e9664c91ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e2884e-5cb2-420f-ae29-b9e9664c91ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c2da11-6ca3-4e04-be6a-0af9592becd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Volume 3172f4ec-eb47-4a0c-9214-1ab6b0d8c343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343', 'volume_size': 1} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1055739072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3172f4ec-eb47-4a0c-9214-1ab6b0d8c343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:15Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Creating volume 3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:15 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-409b3e8a-397d-42ca-9a34-6ca80f988cdf-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "cinder-566c671a-0a72-4953-9de1-8cd001176f8b-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:15 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 1073741824 Sep 28 17:26:15 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Acquiring lock "cinder-quobyte-566c671a-0a72-4953-9de1-8cd001176f8b" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-409b3e8a-397d-42ca-9a34-6ca80f988cdf" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "cinder-quobyte-566c671a-0a72-4953-9de1-8cd001176f8b" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-409b3e8a-397d-42ca-9a34-6ca80f988cdf" acquired by "delete_volume" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecca243-63fb-4f6f-bec0-225932cd11d5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[320ad58d-880e-4c04-898c-4905ca45e5f4]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.502s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:15 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b Sep 28 17:26:15 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf Sep 28 17:26:15 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f19aa7af-b94d-49b9-91cf-ee14f20bbfa1 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-8ab4a5bd-3233-4a94-bd0d-f050a5788a06-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:15 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf" returned: 0 in 0.510s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:15 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:15 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 1073741824" returned: 0 in 0.698s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf Sep 28 17:26:16 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b" returned: 0 in 0.558s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b Sep 28 17:26:16 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 Sep 28 17:26:16 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-409b3e8a-397d-42ca-9a34-6ca80f988cdf" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-409b3e8a-397d-42ca-9a34-6ca80f988cdf" released by "delete_volume" :: held 0.886s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['1f2c4afa-103f-40d0-b927-20613555424b', '08fffacd-e6d7-4ce7-9ea1-7c39dd74996c', 'a9bf2a89-790e-4fe1-a311-798a2a03d60b', '935322d2-5943-4fb9-b4cb-f5c123c0656c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:16 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-566c671a-0a72-4953-9de1-8cd001176f8b" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "cinder-quobyte-566c671a-0a72-4953-9de1-8cd001176f8b" released by "delete_volume" :: held 1.049s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c2da11-6ca3-4e04-be6a-0af9592becd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf43fb3-3507-4895-bfa6-a569dbf05dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Volume volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 (3172f4ec-eb47-4a0c-9214-1ab6b0d8c343): created successfully Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf43fb3-3507-4895-bfa6-a569dbf05dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (e087c941-42f4-4c4f-8213-47875e452dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-06da0e44-2d4d-47e5-b3d3-e7b25ba917c5 tempest-ProjectReaderTests-1615684561 None] Created volume successfully. Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:16 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Created reservations ['81a8880d-1b66-4d43-b6dc-17d6054770ff', '18111a01-704f-4b31-89eb-21840e468b3d', '8f61e81d-0a6c-4322-b7c0-cb376be216b7', '02148c8c-46b9-4f10-a0fb-6676abcb5bd6'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:16 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:16 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:16 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:16 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de30441d-8b2e-46af-9289-03bfbb07ce20 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-409b3e8a-397d-42ca-9a34-6ca80f988cdf-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:16 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.278s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:16 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Deleted volume successfully. Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-f7bde992-d22f-4b37-ab56-d976fce63585 tempest-VolumeAndVolumeTypeFromImageTest-1500913985 None] Lock "cinder-566c671a-0a72-4953-9de1-8cd001176f8b-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-quobyte-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[f887522a-910a-4917-8682-c6c5c89fbfea]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (b9a6f1b7-2938-4848-a7f6-020e8da5b963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7552004-7fd1-47d4-8d7c-473cd2f4b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-ee0a8968-b895-46f7-b0cc-f9832ae34e14-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7552004-7fd1-47d4-8d7c-473cd2f4b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512122262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04674e6-2c69-466f-bee0-613a2a831b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:17Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c2cf17-411e-43ef-8e32-28687cec1b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c2cf17-411e-43ef-8e32-28687cec1b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c8e87-b222-4314-8050-a099a67a7426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 Sep 28 17:26:17 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c8e87-b222-4314-8050-a099a67a7426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c04674e6-2c69-466f-bee0-613a2a831b1d', 'volume_name': 'volume-c04674e6-2c69-466f-bee0-613a2a831b1d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03be5534-182b-4fc6-98d2-40266fb2c877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03be5534-182b-4fc6-98d2-40266fb2c877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cadd3e3-fcf7-4224-8154-b14c9a3a53de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume c04674e6-2c69-466f-bee0-613a2a831b1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c04674e6-2c69-466f-bee0-613a2a831b1d', 'volume_size': 1} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-512122262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c04674e6-2c69-466f-bee0-613a2a831b1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:17Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:17 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-ee0a8968-b895-46f7-b0cc-f9832ae34e14-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:17 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d 1073741824 Sep 28 17:26:17 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-ee0a8968-b895-46f7-b0cc-f9832ae34e14" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-ee0a8968-b895-46f7-b0cc-f9832ae34e14" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f06fbc5-1312-4e59-8417-1c6100dd77f1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:17 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 Sep 28 17:26:17 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" returned: 0 in 0.636s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343 Sep 28 17:26:18 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d 1073741824" returned: 0 in 0.653s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" returned: 0 in 0.312s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343" released by "delete_volume" :: held 1.039s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:18 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d Sep 28 17:26:18 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14" returned: 0 in 0.590s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14 Sep 28 17:26:18 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Created reservations ['d18e711a-4936-46fe-bbdc-ead65b7f3178', '119c4fe2-627f-4452-ae38-88830d5e3df3', '519c3d9a-762f-44a6-943a-b7697f767236', 'c2c2ba6a-b212-4e33-bad0-c28b0a801bd4'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:18 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:18 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:18 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d" returned: 0 in 0.373s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cadd3e3-fcf7-4224-8154-b14c9a3a53de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c04674e6-2c69-466f-bee0-613a2a831b1d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d4b45-72d3-4f7e-bca5-3fb70e0d566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:18 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-c04674e6-2c69-466f-bee0-613a2a831b1d (c04674e6-2c69-466f-bee0-613a2a831b1d): created successfully Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d4b45-72d3-4f7e-bca5-3fb70e0d566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (b9a6f1b7-2938-4848-a7f6-020e8da5b963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ee0a8968-b895-46f7-b0cc-f9832ae34e14" returned: 0 in 0.379s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-ee0a8968-b895-46f7-b0cc-f9832ae34e14" released by "delete_volume" :: held 1.050s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9ee96e56-fab7-4297-937f-19565eddaa40 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['103b67e4-93d4-4573-9173-828cdb6fa82a', '70d5b0c4-5cfe-4044-bb22-32cfc1d69702', '44ffcf69-b7a1-4b30-800f-6ee27f3aa6a2', '7259f037-38d3-463c-a539-f3a45caa8152'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:18 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.372s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Deleted volume successfully. Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-1c114af8-0717-4f1f-a1e8-28e0ff3086b3 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-3172f4ec-eb47-4a0c-9214-1ab6b0d8c343-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:19 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:19 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:19 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.266s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:19 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a13b745c-9da3-44a2-ad56-713d40aaf708 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-ee0a8968-b895-46f7-b0cc-f9832ae34e14-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating offline snapshot 5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 of volume c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (3eda4f91-e2f2-4380-bcb6-dba9bf463c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669da9c9-31e3-4dcf-90e1-01e8a104caf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a27530a-1c5b-4632-9531-60ea76806936]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669da9c9-31e3-4dcf-90e1-01e8a104caf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881861344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9270dcfe-f1a6-4119-b9e7-5d3af948d892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:25Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e78070-2260-4921-bafd-57623d1cc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e78070-2260-4921-bafd-57623d1cc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c470b2-55d8-46de-9718-539ff9f163e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c470b2-55d8-46de-9718-539ff9f163e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9270dcfe-f1a6-4119-b9e7-5d3af948d892', 'volume_name': 'volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945029f-93cb-4157-878c-2bbf1176d1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945029f-93cb-4157-878c-2bbf1176d1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bd9400-00d2-4338-b57d-292bdfdd9c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:26 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Volume 9270dcfe-f1a6-4119-b9e7-5d3af948d892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892', 'volume_size': 1} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "cinder-quobyte-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:26 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d Sep 28 17:26:26 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b09705d-e0b6-42b3-a729-5437ada92336]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 Sep 28 17:26:26 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d" returned: 0 in 0.533s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 1G Sep 28 17:26:26 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" returned: 0 in 0.506s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:26 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87 Sep 28 17:26:26 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:26 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-quobyte-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87" released by "delete_volume" :: held 0.870s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Created reservations ['bb576653-26d1-46b7-9821-f7d7f50dfb3f', '1aaaddc8-9923-4711-9157-5c2da128d128', 'd2f0efdb-22d1-42a7-bd1d-cb3143c8c769', '7d4aaaba-347d-45b1-af56-8ac48c67dab6'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:27 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 1G" returned: 0 in 0.591s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04674e6-2c69-466f-bee0-613a2a831b1d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04674e6-2c69-466f-bee0-613a2a831b1d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 Sep 28 17:26:27 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:27 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.299s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:27 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Deleted volume successfully. Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c04674e6-2c69-466f-bee0-613a2a831b1d -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" returned: 0 in 0.446s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 is being set with open permissions: ugo+rw Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 Sep 28 17:26:27 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4053a1c0-3d65-476a-94d2-5a1da87fcf13 tempest-CreateVolumesFromSourceVolumeTest-1005945484 None] Lock "cinder-8a9fb6d7-4d73-4b33-a5d1-e5b08ac7ee87-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:27 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:27 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info Sep 28 17:26:27 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info" returned: 0 in 0.300s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:28 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info is being set with open permissions: ugo+rw Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info Sep 28 17:26:28 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.info" returned: 0 in 0.311s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.498s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-881861344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9270dcfe-f1a6-4119-b9e7-5d3af948d892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:25Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Creating volume 9270dcfe-f1a6-4119-b9e7-5d3af948d892 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:28 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:28 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 1073741824 Sep 28 17:26:28 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f338e011-af9c-4065-a4c0-e4af82dc6105 tempest-CreateVolumesFromSnapshotTest-970793771 None] Create snapshot completed successfully Sep 28 17:26:29 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 1073741824" returned: 0 in 0.588s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:29 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 Sep 28 17:26:29 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:29 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892" returned: 0 in 0.411s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bd9400-00d2-4338-b57d-292bdfdd9c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0bf053-5da8-4a63-a743-bb98bb848ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:29 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Volume volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 (9270dcfe-f1a6-4119-b9e7-5d3af948d892): created successfully Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd0bf053-5da8-4a63-a743-bb98bb848ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:29 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (3eda4f91-e2f2-4380-bcb6-dba9bf463c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7ec8e320-3237-4a16-9aa1-49d01a92d31b tempest-ProjectReaderTests-1615684561 None] Created volume successfully. Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Flow 'volume_create_manager' (fa2c06b9-8e92-4f99-8b53-b529aab5aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b06f309-1a30-4feb-92eb-e5d244a0f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b06f309-1a30-4feb-92eb-e5d244a0f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-193690445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff773618-c3eb-46bb-a78f-706b5f58e8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a77d94c0c847cd9baa5199720669c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='b86239ed4a29447883f3c73748f63ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05e6e4-7f98-4b69-b6db-462ea7ad3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb05e6e4-7f98-4b69-b6db-462ea7ad3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b34d78b-82e5-4db9-8529-d3de1fd044b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b34d78b-82e5-4db9-8529-d3de1fd044b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff773618-c3eb-46bb-a78f-706b5f58e8f9', 'volume_name': 'volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50b3b81-35c7-4ac5-be26-e42564444502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b50b3b81-35c7-4ac5-be26-e42564444502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caa3cfd-ec84-4f3e-969f-88d02ef9f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Volume ff773618-c3eb-46bb-a78f-706b5f58e8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9', 'volume_size': 1} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-193690445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff773618-c3eb-46bb-a78f-706b5f58e8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a77d94c0c847cd9baa5199720669c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='b86239ed4a29447883f3c73748f63ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Creating volume ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:30 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:30 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 1073741824 Sep 28 17:26:30 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (573df637-1122-42a8-a3b6-7140ffc8acda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd15d33-a068-4f67-a285-5d1a1e6e0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd15d33-a068-4f67-a285-5d1a1e6e0607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502649813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c990274-b378-4578-8bd7-c2a30b58eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c990274-b378-4578-8bd7-c2a30b58eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b11f2-1fa6-4f24-ab7b-08cd78dfa0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5b11f2-1fa6-4f24-ab7b-08cd78dfa0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed', 'volume_name': 'volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ed42a-a9ca-41ff-a51a-9997a18e0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514ed42a-a9ca-41ff-a51a-9997a18e0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd86cfd8-d79c-4ff4-a18f-6ee87115248b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume 46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed', 'volume_size': 1} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (6db28eaa-bde0-453e-ace6-e411483088fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff7d1d-6bd1-4f44-94a2-6c008743e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cff7d1d-6bd1-4f44-94a2-6c008743e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-718569317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bbe895-3d3d-44a4-9c62-094360208489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8cafc2-3114-46a0-80fa-572de851ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f8cafc2-3114-46a0-80fa-572de851ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7ab2a4-781d-4fd3-b498-5eabb81fc539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7ab2a4-781d-4fd3-b498-5eabb81fc539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bbe895-3d3d-44a4-9c62-094360208489', 'volume_name': 'volume-45bbe895-3d3d-44a4-9c62-094360208489', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafb1729-dd17-415a-99d3-dde8c14cbf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cafb1729-dd17-415a-99d3-dde8c14cbf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dca344-9d89-4f16-b187-e82a3aa3c6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume 45bbe895-3d3d-44a4-9c62-094360208489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bbe895-3d3d-44a4-9c62-094360208489', 'volume_size': 1} Sep 28 17:26:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-9270dcfe-f1a6-4119-b9e7-5d3af948d892-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "cinder-9270dcfe-f1a6-4119-b9e7-5d3af948d892-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-quobyte-9270dcfe-f1a6-4119-b9e7-5d3af948d892" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-9270dcfe-f1a6-4119-b9e7-5d3af948d892" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:31 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 1073741824" returned: 0 in 0.802s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[107f4812-fdc4-4c0f-9450-71f8351d2de2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:31 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:31 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 Sep 28 17:26:31 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (5e002cb8-1424-4a08-ade1-553027915ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b67a4-1486-48f1-b994-0df9bb188361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3b67a4-1486-48f1-b994-0df9bb188361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573930807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e19d30a-b3cd-418b-aa11-f9dd454e6d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113dd8e-73cd-4428-bf19-379fe3922149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6113dd8e-73cd-4428-bf19-379fe3922149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa0e28-a72e-4dd3-aea8-44ef8efa94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aa0e28-a72e-4dd3-aea8-44ef8efa94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e19d30a-b3cd-418b-aa11-f9dd454e6d62', 'volume_name': 'volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bf7f52-7639-4ced-aa97-1c176be0725e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50bf7f52-7639-4ced-aa97-1c176be0725e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a691a0-bd48-4613-8d24-c16080a1c3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume 0e19d30a-b3cd-418b-aa11-f9dd454e6d62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62', 'volume_size': 1} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.487s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-502649813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:30Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume 46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:31 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4caa3cfd-ec84-4f3e-969f-88d02ef9f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed 1073741824 Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153f3d31-7c0f-4701-8d95-76e1eaabcdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:31 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Volume volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 (ff773618-c3eb-46bb-a78f-706b5f58e8f9): created successfully Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (153f3d31-7c0f-4701-8d95-76e1eaabcdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Flow 'volume_create_manager' (fa2c06b9-8e92-4f99-8b53-b529aab5aad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:31 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892" returned: 0 in 0.723s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dce59169-6354-4c98-90e0-3c226fbff464 tempest-VolumeDependencyTests-931675283 None] Created volume successfully. Sep 28 17:26:32 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892 Sep 28 17:26:32 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (29ff8e29-7c44-49f8-8663-b51bc183c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423b2179-b1ad-49f4-b9ee-a09ea07ce0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (423b2179-b1ad-49f4-b9ee-a09ea07ce0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840844140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f15f58-aa95-4300-9fe8-173089b3ff5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ee3d0-0494-4f2e-9074-1fdad573509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d23ee3d0-0494-4f2e-9074-1fdad573509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff84b8b-089f-42a4-a534-51754d51afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff84b8b-089f-42a4-a534-51754d51afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f15f58-aa95-4300-9fe8-173089b3ff5e', 'volume_name': 'volume-67f15f58-aa95-4300-9fe8-173089b3ff5e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf6e76c-13ab-4a44-94ce-9ffc6b5f5fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baf6e76c-13ab-4a44-94ce-9ffc6b5f5fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c8fceb-5a93-4e3a-a56d-1fddb67afa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:32 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume 67f15f58-aa95-4300-9fe8-173089b3ff5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f15f58-aa95-4300-9fe8-173089b3ff5e', 'volume_size': 1} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:32 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9270dcfe-f1a6-4119-b9e7-5d3af948d892" returned: 0 in 0.586s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-9270dcfe-f1a6-4119-b9e7-5d3af948d892" released by "delete_volume" :: held 1.434s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Created reservations ['3b2f4b78-c6e4-4a13-9c91-2e68c7779c90', '805ad456-cfc9-49dc-9ec4-8ac746f179b0', '921b6d34-edd4-4e8a-bebb-f2e7028e2cd6', '114060c9-b099-4b03-a4e6-551bc86451b6'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:32 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed 1073741824" returned: 0 in 1.016s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:32 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:32 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed Sep 28 17:26:33 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (daf34b38-c8fc-41a4-ab0b-ea3a879013d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850d0b72-e255-4fea-a39e-59c958c44d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850d0b72-e255-4fea-a39e-59c958c44d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244943213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:33Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63abb67c-041e-4b5b-9e89-6341ce6f9b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63abb67c-041e-4b5b-9e89-6341ce6f9b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd60821-4889-4ced-a9f2-35106d2ecf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd60821-4889-4ced-a9f2-35106d2ecf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d', 'volume_name': 'volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda26384-0274-41fc-af26-6f5db93b7d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda26384-0274-41fc-af26-6f5db93b7d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e8b576-2d26-41cd-81c6-007f96097711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume 42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d', 'volume_size': 1} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.407s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Deleted volume successfully. Sep 28 17:26:33 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b1d48b0-5953-43be-bee6-34516c57457c tempest-ProjectReaderTests-1615684561 None] Lock "cinder-9270dcfe-f1a6-4119-b9e7-5d3af948d892-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" returned: 0 in 0.434s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-718569317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bbe895-3d3d-44a4-9c62-094360208489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume 45bbe895-3d3d-44a4-9c62-094360208489 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:33 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 1073741824 Sep 28 17:26:33 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd86cfd8-d79c-4ff4-a18f-6ee87115248b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566a0800-fef7-4232-8543-eff02b07ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed (46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed): created successfully Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566a0800-fef7-4232-8543-eff02b07ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (573df637-1122-42a8-a3b6-7140ffc8acda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8b2b67d1-87e4-47cb-a704-f87dd24c6589 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Flow 'volume_create_manager' (cdd66743-4ecd-4f3f-94ad-6ac9ae54fb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb3708d-f063-4c79-9b9d-2e98d78c1749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb3708d-f063-4c79-9b9d-2e98d78c1749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603770bd9cc642a1ab0213034c9222c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='0ac33398836a486a8e48fb83ad92b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4636ab33-3dda-44ee-bbe2-974956536586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4636ab33-3dda-44ee-bbe2-974956536586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414e84d0-e5a9-456c-a41f-91558f554f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (414e84d0-e5a9-456c-a41f-91558f554f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea', 'volume_name': 'volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8763724b-cca5-4673-bf5c-b995179c57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8763724b-cca5-4673-bf5c-b995179c57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476b63a-eb75-4540-93de-6a2ec7364da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Volume e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea', 'volume_size': 1} Sep 28 17:26:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:34 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 1073741824" returned: 0 in 0.624s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 Sep 28 17:26:34 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (ff0401b0-5e37-4348-9380-b4caad09daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93194289-55c6-44fe-81ea-2e566ea7c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93194289-55c6-44fe-81ea-2e566ea7c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647801513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf18454-19b8-468a-ab8c-5ef2ec8a6342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf025de9-53b9-42d9-9445-49898008e901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf025de9-53b9-42d9-9445-49898008e901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd27cd-d119-438c-9a6f-943fd7a3fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bd27cd-d119-438c-9a6f-943fd7a3fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf18454-19b8-468a-ab8c-5ef2ec8a6342', 'volume_name': 'volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8884b75-cffc-4e4c-a0d2-95bf62f6f374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8884b75-cffc-4e4c-a0d2-95bf62f6f374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67df1411-f6e6-4d24-9f7c-f063415f16cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Volume abf18454-19b8-468a-ab8c-5ef2ec8a6342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342', 'volume_size': 1} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:34 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489" returned: 0 in 0.341s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.772s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-573930807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e19d30a-b3cd-418b-aa11-f9dd454e6d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:31Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume 0e19d30a-b3cd-418b-aa11-f9dd454e6d62 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:34 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3dca344-9d89-4f16-b187-e82a3aa3c6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bbe895-3d3d-44a4-9c62-094360208489', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 1073741824 Sep 28 17:26:34 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13983752-43d0-4fd3-86e7-b6df10122dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-45bbe895-3d3d-44a4-9c62-094360208489 (45bbe895-3d3d-44a4-9c62-094360208489): created successfully Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13983752-43d0-4fd3-86e7-b6df10122dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (6db28eaa-bde0-453e-ace6-e411483088fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5eb55b6e-93f0-44fa-b719-a6c921a42242 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:34 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 1073741824" returned: 0 in 0.470s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 Sep 28 17:26:35 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" returned: 0 in 0.327s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.004s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-840844140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f15f58-aa95-4300-9fe8-173089b3ff5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:32Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume 67f15f58-aa95-4300-9fe8-173089b3ff5e {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:35 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9a691a0-bd48-4613-8d24-c16080a1c3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab54b6-ea3d-426e-bd80-a771ea1b9b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:35 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e 1073741824 Sep 28 17:26:35 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:35 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 (0e19d30a-b3cd-418b-aa11-f9dd454e6d62): created successfully Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab54b6-ea3d-426e-bd80-a771ea1b9b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (5e002cb8-1424-4a08-ade1-553027915ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:35 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b6600e23-45f8-4f68-a517-f2f9cff1dde0 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:35 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e 1073741824" returned: 0 in 0.520s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:35 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e Sep 28 17:26:35 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e" returned: 0 in 0.251s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.209s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c8fceb-5a93-4e3a-a56d-1fddb67afa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f15f58-aa95-4300-9fe8-173089b3ff5e', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44ed166-0ac6-45d3-b3f0-30b64e0fe64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Creating offline snapshot dbb32c8f-164c-4f46-a66f-1b1d57f80f6d of volume ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:36 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-67f15f58-aa95-4300-9fe8-173089b3ff5e (67f15f58-aa95-4300-9fe8-173089b3ff5e): created successfully Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44ed166-0ac6-45d3-b3f0-30b64e0fe64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (29ff8e29-7c44-49f8-8663-b51bc183c19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c3bf6-98bf-475f-8aa5-16d0f1690d2f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-35af117c-a538-4b0a-a112-b8e4fa25cb73 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:36 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:36 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:36 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.429s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:36 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d 1G Sep 28 17:26:36 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d 1G" returned: 0 in 0.408s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:37 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.293s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d is being set with open permissions: ugo+rw Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:37 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.241s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info Sep 28 17:26:37 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:37 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info" returned: 0 in 0.251s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:37 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info is being set with open permissions: ugo+rw Sep 28 17:26:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:37 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info Sep 28 17:26:37 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.info" returned: 0 in 0.248s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.964s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-244943213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b851437927438793075e5bb8815dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:33Z,use_quota=True,user_id='e3e9383508aa488891ec4a647a8441f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Creating volume 42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:38 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d 1073741824 Sep 28 17:26:38 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-929c5cd2-d3d3-4b30-9177-7c0a8f63df0e tempest-VolumeDependencyTests-931675283 None] Create snapshot completed successfully Sep 28 17:26:38 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d 1073741824" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d Sep 28 17:26:38 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" returned: 0 in 0.263s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.108s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603770bd9cc642a1ab0213034c9222c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='0ac33398836a486a8e48fb83ad92b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Creating volume e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:38 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e8b576-2d26-41cd-81c6-007f96097711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:38 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea 1073741824 Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9dc28a-a7a0-4c3f-932b-42418b5f6ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:38 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:38 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Volume volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d (42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d): created successfully Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9dc28a-a7a0-4c3f-932b-42418b5f6ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Flow 'volume_create_manager' (daf34b38-c8fc-41a4-ab0b-ea3a879013d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:39 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e392e96f-784a-42ea-9aaf-4598f87fd860 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created volume successfully. Sep 28 17:26:39 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea 1073741824" returned: 0 in 0.539s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea Sep 28 17:26:39 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9c1667-802e-4bc4-a504-b33f07f64743]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" returned: 0 in 0.321s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.535s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-647801513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf18454-19b8-468a-ab8c-5ef2ec8a6342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3a2a29117d4f2dbb15f2d7a3427ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:34Z,use_quota=True,user_id='f789c59871a341a28be6d39fe5e18051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Creating volume abf18454-19b8-468a-ab8c-5ef2ec8a6342 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:39 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:39 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 1073741824 Sep 28 17:26:39 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b476b63a-eb75-4540-93de-6a2ec7364da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5149227-61ba-4f73-821c-7fdf0535fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Flow 'volume_create_manager' (26f52a73-662b-4104-9d5f-5238ae807d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10032ed4-6f15-41ca-ac92-12808bc98049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:39 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Volume volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea (e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea): created successfully Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5149227-61ba-4f73-821c-7fdf0535fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:39 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Flow 'volume_create_manager' (cdd66743-4ecd-4f3f-94ad-6ac9ae54fb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:39 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10032ed4-6f15-41ca-ac92-12808bc98049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-948173026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d9a12b-f00d-4cfa-b50e-77e334d60ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a77d94c0c847cd9baa5199720669c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dbb32c8f-164c-4f46-a66f-1b1d57f80f6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:40Z,use_quota=True,user_id='b86239ed4a29447883f3c73748f63ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fa3f53-0db1-4d94-b4c0-5fedecdf2fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5fa3f53-0db1-4d94-b4c0-5fedecdf2fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb7cab8-2f6d-450a-9cf7-64730cbe6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb7cab8-2f6d-450a-9cf7-64730cbe6a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c5d9a12b-f00d-4cfa-b50e-77e334d60ff0', 'volume_name': 'volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0', 'volume_size': 1, 'snapshot_id': 'dbb32c8f-164c-4f46-a66f-1b1d57f80f6d'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34e6464-46a1-402c-a58f-ec8da8633e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34e6464-46a1-402c-a58f-ec8da8633e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378b7d77-5a76-482a-b8ab-2152071f51df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:40 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Volume c5d9a12b-f00d-4cfa-b50e-77e334d60ff0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0', 'volume_size': 1, 'snapshot_id': 'dbb32c8f-164c-4f46-a66f-1b1d57f80f6d'} Sep 28 17:26:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0699760c-5a4b-4490-bcf4-be606fd36ec6 tempest-CinderUnicodeTest-1596331109 None] Created volume successfully. Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d Sep 28 17:26:40 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 1073741824" returned: 0 in 0.504s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 Sep 28 17:26:40 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d" released by "delete_volume" :: held 0.835s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['8c81340b-4779-465c-afb6-0033e30031f3', 'c5fcd3ab-b2c7-4ff2-bc6d-b92cb29c12a0', '42363f45-a9b6-413f-a37b-694c3f5852ee', 'b102e7f6-5821-42d2-9225-22b435c25081'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:40 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342" returned: 0 in 0.309s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.682s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67df1411-f6e6-4d24-9f7c-f063415f16cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e58322-3e4e-473e-acfd-7488e7f6790b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Creating volume c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 from snapshot dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:40 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:40 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:40 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Volume volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 (abf18454-19b8-468a-ab8c-5ef2ec8a6342): created successfully Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e58322-3e4e-473e-acfd-7488e7f6790b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Flow 'volume_create_manager' (ff0401b0-5e37-4348-9380-b4caad09daf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] snapshot: dbb32c8f-164c-4f46-a66f-1b1d57f80f6d, volume: c5d9a12b-f00d-4cfa-b50e-77e334d60ff0, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:26:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c550a79a-0d2d-4831-b196-e1498e98fde6 tempest-ProjectReaderTests-1615684561 None] Created volume successfully. Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-67f15f58-aa95-4300-9fe8-173089b3ff5e-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-67f15f58-aa95-4300-9fe8-173089b3ff5e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a55981f-e5f9-4426-87fe-1f7bcab956e8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-67f15f58-aa95-4300-9fe8-173089b3ff5e" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-67f15f58-aa95-4300-9fe8-173089b3ff5e" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d16517-1121-4c14-98e7-690958bfe2c9]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.276s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5e9dd227-f00c-45f2-8223-28673494bed1 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-42bc7e5e-3dc5-4838-a6ae-0e7c8b58040d-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:41 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:41 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e Sep 28 17:26:41 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.465s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee129a4-690c-46b6-9a93-c4eb23f82ffa]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e" returned: 0 in 0.404s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:41 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e Sep 28 17:26:41 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:41 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:41 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-67f15f58-aa95-4300-9fe8-173089b3ff5e" returned: 0 in 0.319s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-67f15f58-aa95-4300-9fe8-173089b3ff5e" released by "delete_volume" :: held 0.788s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-abf18454-19b8-468a-ab8c-5ef2ec8a6342-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-abf18454-19b8-468a-ab8c-5ef2ec8a6342-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Flow 'volume_create_manager' (492dbd58-6cc7-4a87-914c-7a00d1b1b819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891c8843-74b5-4d9e-9688-d19dde19e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (891c8843-74b5-4d9e-9688-d19dde19e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-606530999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4d9ec8-a75e-498b-9b7a-2bc278d16b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603770bd9cc642a1ab0213034c9222c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:42Z,use_quota=True,user_id='0ac33398836a486a8e48fb83ad92b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c44d9-d17b-4fd9-a410-4c885331b307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3c44d9-d17b-4fd9-a410-4c885331b307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b49147-b426-4f52-afb8-a321b9f9e32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b49147-b426-4f52-afb8-a321b9f9e32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de4d9ec8-a75e-498b-9b7a-2bc278d16b59', 'volume_name': 'volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393acbf0-4b9b-4bf3-8055-d0d26dfe30de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (393acbf0-4b9b-4bf3-8055-d0d26dfe30de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb73fc1d-0b9b-4a8f-94b9-36fc1388f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:41 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Volume de4d9ec8-a75e-498b-9b7a-2bc278d16b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59', 'volume_size': 1} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.538s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:26:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 Sep 28 17:26:42 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "cinder-quobyte-abf18454-19b8-468a-ab8c-5ef2ec8a6342" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['c4f4d90a-3a6b-4343-87d1-1334b085725c', 'e98bd2bf-2e2c-422d-8619-d91a71bf7583', 'a9fd4beb-0445-44e9-b643-e0329f544454', 'b47edcd2-a9dc-49a5-9ba9-85dccdc8c672'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-abf18454-19b8-468a-ab8c-5ef2ec8a6342" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccef257-068f-4905-98a6-8f2a7574917b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:42 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 Sep 28 17:26:42 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:42 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.297s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:42 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a94d0f68-198c-410b-83ff-026452859345 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-67f15f58-aa95-4300-9fe8-173089b3ff5e-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:42 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342" returned: 0 in 0.483s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:42 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342 Sep 28 17:26:42 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-abf18454-19b8-468a-ab8c-5ef2ec8a6342" returned: 0 in 0.482s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-quobyte-abf18454-19b8-468a-ab8c-5ef2ec8a6342" released by "delete_volume" :: held 1.037s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-0e19d30a-b3cd-418b-aa11-f9dd454e6d62-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Created reservations ['527c81c6-e628-49ac-9b74-5dcd83b9cb43', 'c7db3c3d-37d9-4ef7-a696-b7b36006baf6', '02d6855d-8880-4912-ae5b-99c3d314761c', '62bf1d3a-8219-4f55-b3d7-95da88201d2b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-0e19d30a-b3cd-418b-aa11-f9dd454e6d62-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d2c18c-00c9-4add-b641-8cb71d221141]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:43 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:43 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:43 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 Sep 28 17:26:43 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.513s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Deleted volume successfully. Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0770da41-c82c-41b9-8fc3-66b8e9e11a75 tempest-ProjectReaderTests-1615684561 None] Lock "cinder-abf18454-19b8-468a-ab8c-5ef2ec8a6342-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:44 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" returned: 0 in 0.616s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62 Sep 28 17:26:44 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:44 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:44 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:44 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-0e19d30a-b3cd-418b-aa11-f9dd454e6d62" released by "delete_volume" :: held 1.226s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['ce72f1be-4916-40f3-ac1c-0fb6737b7548', '38e95448-2d89-45f7-a982-0c4de5f882c2', 'cb3fabc8-f494-41e0-a919-1a19d31ce563', '42f9dadf-19f2-4a34-9a0e-5070e823c059'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:45 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:45 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:45 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.516s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:26:45 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.608s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:45 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a5742366-4578-4515-83cd-2e8cf2bb2072 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-0e19d30a-b3cd-418b-aa11-f9dd454e6d62-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-45bbe895-3d3d-44a4-9c62-094360208489-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-45bbe895-3d3d-44a4-9c62-094360208489-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-45bbe895-3d3d-44a4-9c62-094360208489" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-45bbe895-3d3d-44a4-9c62-094360208489" acquired by "delete_volume" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b313c8e-7129-4490-ad5a-09c52ff3a625]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:46 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 Sep 28 17:26:46 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:46 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489" returned: 0 in 0.699s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:46 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489 Sep 28 17:26:46 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-45bbe895-3d3d-44a4-9c62-094360208489" returned: 0 in 0.505s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-45bbe895-3d3d-44a4-9c62-094360208489" released by "delete_volume" :: held 1.296s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['5cbcd487-a90d-4dc8-8b30-e76981707f16', 'b6a7329f-98dd-4387-a9a8-517a594fa83d', 'e67c09a3-ea1e-42c3-8ce4-8d6b48fbfb75', '7c4380c2-b439-4de7-a8ac-6d858b7b392b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:47 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:47 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:47 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.411s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-577a89f9-6a02-417f-8665-787d3668a55a tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-45bbe895-3d3d-44a4-9c62-094360208489-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d89a50-11bb-445f-b173-5ff7d03fa56e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:48 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed Sep 28 17:26:48 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" returned: 0 in 0.805s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed Sep 28 17:26:49 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" returned: 0 in 7.495s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:26:49 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Converted 1024.00 MB image at 136.60 MB/s Sep 28 17:26:49 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 is being set with open permissions: ugo+rw Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 Sep 28 17:26:49 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" returned: 0 in 0.429s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed" released by "delete_volume" :: held 1.323s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['3604a211-798e-409a-9edf-a33a5aa8d69d', 'd99c8140-bd85-4250-9f76-b2d243e69125', '1c21f818-373f-4b3f-b22c-b7d8da7d8da5', 'ee249786-bb6a-4e65-a08d-ef720c89acf8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:49 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" returned: 0 in 0.255s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" released by "_copy_volume_from_snapshot" :: held 8.888s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" released by "_create_volume_from_snapshot" :: held 9.007s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.052s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.826s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:26:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-606530999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de4d9ec8-a75e-498b-9b7a-2bc278d16b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='603770bd9cc642a1ab0213034c9222c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:26:42Z,use_quota=True,user_id='0ac33398836a486a8e48fb83ad92b384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Creating volume de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:26:49 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:49 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 1073741824 Sep 28 17:26:49 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (378b7d77-5a76-482a-b8ab-2152071f51df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0', 'volume_size': 1, 'snapshot_id': 'dbb32c8f-164c-4f46-a66f-1b1d57f80f6d'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2a19e-3ccf-4d24-abe5-d1e03bec8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:49 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Volume volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 (c5d9a12b-f00d-4cfa-b50e-77e334d60ff0): created successfully Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2a19e-3ccf-4d24-abe5-d1e03bec8168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Flow 'volume_create_manager' (26f52a73-662b-4104-9d5f-5238ae807d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-cfdb173e-f32b-48e2-b328-ee1c596d5f2a tempest-VolumeDependencyTests-931675283 None] Created volume successfully. Sep 28 17:26:49 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.251s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:49 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-3ed7481d-4a35-4430-8268-54e28ea76dcb tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-46d4ebcc-64f6-4a49-85ad-8f4c1268a5ed-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:50 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 1073741824" returned: 0 in 0.439s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 Sep 28 17:26:50 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleting offline snapshot 5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 of volume c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] snapshot_file for this snap is: volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d477f44-a2af-48c2-ad7b-e6712e7c259a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" returned: 0 in 0.260s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb73fc1d-0b9b-4a8f-94b9-36fc1388f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:50 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe11649-dd6a-494c-8691-61531e586fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:26:50 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Volume volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 (de4d9ec8-a75e-498b-9b7a-2bc278d16b59): created successfully Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe11649-dd6a-494c-8691-61531e586fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Flow 'volume_create_manager' (492dbd58-6cc7-4a87-914c-7a00d1b1b819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:26:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2067afe3-84b7-42c2-91cd-831107d315ee tempest-CinderUnicodeTest-1596331109 None] Created volume successfully. Sep 28 17:26:50 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" returned: 0 in 0.383s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c04674e6-2c69-466f-bee0-613a2a831b1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[673ca13f-46e6-4dde-a7bb-ed6aa81f929c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Deleting offline snapshot dbb32c8f-164c-4f46-a66f-1b1d57f80f6d of volume ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] snapshot_file for this snap is: volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f99951-147b-4543-9569-ff5f1f49ac0a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d Sep 28 17:26:51 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Creating offline snapshot 8929ed81-ee97-4d0d-b265-4b5fb3cbc182 of volume de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2e5e3a-ddb5-42e2-8b17-5f39bbec7df3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:51 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 Sep 28 17:26:51 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d" returned: 0 in 0.461s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 Sep 28 17:26:51 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.431s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:51 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" returned: 0 in 0.409s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec49aebd-1b49-401a-81a2-f83d9e4cd47f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 1G Sep 28 17:26:51 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:51 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" returned: 0 in 0.386s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83 Sep 28 17:26:51 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:51 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 1G" returned: 0 in 0.433s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:51 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 Sep 28 17:26:51 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d.5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" returned: 0 in 0.277s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83" released by "_delete_snapshot" :: held 1.649s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" released by "delete_snapshot" :: held 1.674s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.619s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:52 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['6ddcbdd9-0ef5-4d72-a27d-ec93c6b2ecbe', '9b51abfd-88b0-449e-85ce-0026d7982f49', '3e06df18-4d1c-4e1c-8797-8e7630e8e260', '8b1e33f4-58b8-4651-8296-c97864674558'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:52 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Delete snapshot completed successfully. Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-80a3ef41-c3f0-4c3b-9450-d24820470567 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-5ffe0ccf-c159-4fee-a4ea-3d1a7a545e83-delete_snapshot" released by "delete_snapshot" :: held 1.851s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 is being set with open permissions: ugo+rw Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 Sep 28 17:26:52 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-c04674e6-2c69-466f-bee0-613a2a831b1d-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:52 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d Sep 28 17:26:52 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-c04674e6-2c69-466f-bee0-613a2a831b1d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182" returned: 0 in 0.295s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:52 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info Sep 28 17:26:52 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5536d03a-9709-4bdc-ad58-c454dd6692c5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d Sep 28 17:26:52 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9.dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" returned: 0 in 0.305s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d" released by "_delete_snapshot" :: held 1.927s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" released by "delete_snapshot" :: held 1.959s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:52 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:52 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info is being set with open permissions: ugo+rw Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:52 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info Sep 28 17:26:52 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:52 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Created reservations ['3eec7941-d3b1-4823-b25a-0a6bfb27c4f3', 'd753a6ee-b36d-42f6-a411-d687e692d10b', 'eb05d492-21be-4d62-b2d6-e8a380cc735f', 'eb93ceba-a848-4c37-8464-063b2e22b2a0'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Delete snapshot completed successfully. Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9e42e7c1-98bf-4e2a-b585-ecadd2cb025e tempest-VolumeDependencyTests-931675283 None] Lock "cinder-dbb32c8f-164c-4f46-a66f-1b1d57f80f6d-delete_snapshot" released by "delete_snapshot" :: held 2.146s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:53 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d" returned: 0 in 0.407s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:53 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d Sep 28 17:26:53 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:53 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.info" returned: 0 in 0.277s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.198s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6fe5de22-de64-44f9-87a8-1c9399818060 tempest-CinderUnicodeTest-1596331109 None] Create snapshot completed successfully Sep 28 17:26:53 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c04674e6-2c69-466f-bee0-613a2a831b1d" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-quobyte-c04674e6-2c69-466f-bee0-613a2a831b1d" released by "delete_volume" :: held 0.730s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Created reservations ['10ca0ce8-cd4a-4a59-8328-9067e69f2b0f', 'f94e6e81-6885-41cb-adf4-83e360e70536', '557aa486-be39-4680-a59a-fd2dcea44159', '1509fa28-f149-4b15-95c0-1a9ed0a63e37'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:53 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:53 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:53 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.241s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Deleted volume successfully. Sep 28 17:26:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-04e4d814-e018-4238-b501-00cf95a5e2b7 tempest-CreateVolumesFromSnapshotTest-970793771 None] Lock "cinder-c04674e6-2c69-466f-bee0-613a2a831b1d-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-ff773618-c3eb-46bb-a78f-706b5f58e8f9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "cinder-ff773618-c3eb-46bb-a78f-706b5f58e8f9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-8929ed81-ee97-4d0d-b265-4b5fb3cbc182-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" acquired by "delete_volume" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-8929ed81-ee97-4d0d-b265-4b5fb3cbc182-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a67da86-aed7-4391-9051-ef9421938224]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-quobyte-8929ed81-ee97-4d0d-b265-4b5fb3cbc182" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-8929ed81-ee97-4d0d-b265-4b5fb3cbc182" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Deleting offline snapshot 8929ed81-ee97-4d0d-b265-4b5fb3cbc182 of volume de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] snapshot_file for this snap is: volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9309311-fa39-476c-ad6a-8d99c152f51c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:54 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:54 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 Sep 28 17:26:54 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.478s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:54 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9 Sep 28 17:26:54 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:54 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182" returned: 0 in 0.525s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:54 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef20f825-ef35-4718-8927-547f37a4b27c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:55 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-ff773618-c3eb-46bb-a78f-706b5f58e8f9" returned: 0 in 0.263s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-ff773618-c3eb-46bb-a78f-706b5f58e8f9" released by "delete_volume" :: held 0.846s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=189,cinder:UPDATE=282,cinder:DELETE=25,cinder:INSERT=66 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:55 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 Sep 28 17:26:55 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Created reservations ['8e53c47f-df1d-4102-a1b5-f5f4eb5db25d', '66ac27b1-767c-4baa-bd5f-ee86d8e9cf50', 'f95eda18-c248-4733-b11c-2759a3d77440', '0dbb3303-82d3-48ee-bf65-a1700fe5aea7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:55 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:55 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:55 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" returned: 0 in 0.545s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:55 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 Sep 28 17:26:55 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:55 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.332s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Deleted volume successfully. Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07c327d9-e53e-4629-9732-93f4c4c84045 tempest-VolumeDependencyTests-931675283 None] Lock "cinder-ff773618-c3eb-46bb-a78f-706b5f58e8f9-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:55 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182" returned: 0 in 0.386s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:55 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182 Sep 28 17:26:55 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:56 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59.8929ed81-ee97-4d0d-b265-4b5fb3cbc182" returned: 0 in 0.299s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=271,cinder:SELECT=204,cinder:INSERT=73,cinder:DELETE=26 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-8929ed81-ee97-4d0d-b265-4b5fb3cbc182" released by "_delete_snapshot" :: held 1.928s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" released by "delete_snapshot" :: held 1.963s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Created reservations ['f190e862-fc59-4060-8942-3147a5d291a5', '59a63316-737d-4e50-9b00-712f06f6c74c', '64d12ce6-91be-4780-9aff-62f2a9ec5c13', '16673a3b-498e-4147-9407-afb3ba1e857b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7cc127-21bf-4561-a32f-c79c84cf6ce8]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:56 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Delete snapshot completed successfully. Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0c49221b-0933-4314-9a25-0b4ff187d554 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-8929ed81-ee97-4d0d-b265-4b5fb3cbc182-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:56 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 Sep 28 17:26:56 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:56 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:56 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0 Sep 28 17:26:56 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:57 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" returned: 0 in 0.253s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-quobyte-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0" released by "delete_volume" :: held 0.719s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Created reservations ['59886b0c-8c66-4f0a-8899-f35fd6025c68', 'ae7483c3-8022-4e32-97a8-f2561cd68a44', '162c9912-9c3a-47ea-8257-2818ee797fa5', '331ec4fa-cae7-47b1-92df-de6c8746bc0f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:57 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:57 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-de4d9ec8-a75e-498b-9b7a-2bc278d16b59-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-de4d9ec8-a75e-498b-9b7a-2bc278d16b59-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:57 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.404s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Deleted volume successfully. Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b1ad4a-0570-4437-8f2f-5a989e138875]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-2cd71c3e-bbd5-4044-b333-8bc860e1c22a tempest-VolumeDependencyTests-931675283 None] Lock "cinder-c5d9a12b-f00d-4cfa-b50e-77e334d60ff0-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:57 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 Sep 28 17:26:57 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" returned: 0 in 0.445s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59 Sep 28 17:26:58 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-de4d9ec8-a75e-498b-9b7a-2bc278d16b59" released by "delete_volume" :: held 0.876s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Created reservations ['2bdf498d-756a-4ece-9993-c37332846f59', '68c9ae39-cc34-43e3-b7ec-9322452d24de', '760c66a7-06d6-49c3-a9e6-17731ff8cf93', 'ece6093a-253c-48cc-8811-2beda5c38a2f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:58 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:58 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "cinder-quobyte-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3513ddcc-dfdd-4f67-a845-99b02fa28cd5]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:26:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea Sep 28 17:26:59 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.397s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:26:59 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Deleted volume successfully. Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-5698f8f2-4c63-4fc8-8b0b-dc1aa131353a tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-de4d9ec8-a75e-498b-9b7a-2bc278d16b59-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:59 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea Sep 28 17:26:59 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:26:59 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-quobyte-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea" released by "delete_volume" :: held 0.788s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Created reservations ['0729cbbc-63cc-43b3-8ed8-bd30c07539ba', 'fa53492f-4334-466c-88c1-b12c51e4d1b0', 'a2cfc295-b91d-4183-a321-ff8d00b3157c', '8896df85-0288-442f-b839-d148e2c8750b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:26:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:26:59 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:26:59 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:00 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:00 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Deleted volume successfully. Sep 28 17:27:00 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-84890ceb-a772-40ba-8b12-7f9b06d35fa0 tempest-CinderUnicodeTest-1596331109 None] Lock "cinder-e1e1a8f5-7e12-41a4-aacb-8fc50201d8ea-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Flow 'volume_create_manager' (a24db6cd-5a04-431e-9f0c-05c26de8569b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8539e9-eb0a-4caa-8c3c-a6b4e4215f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8539e9-eb0a-4caa-8c3c-a6b4e4215f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b104c136ddb14a5caa3e6779d2fafb87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:05Z,use_quota=True,user_id='391dff4c7aad48f9be8a99d5f45f8967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4b6897-1a15-45b3-bf10-4d29fe2afe95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4b6897-1a15-45b3-bf10-4d29fe2afe95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dc47c-7e62-45e7-8669-9241b3575511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:04 devstack cinder-volume[86842]: DEBUG cinder.image.glance [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Creating Keystone auth plugin from conf {{(pid=86842) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (b17c802e-05a2-4469-a6ef-09e75f35a7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0e198e-c2f4-4a39-9b2c-bbc2294ba8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0e198e-c2f4-4a39-9b2c-bbc2294ba8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2089484475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794488a-6e57-496b-93f2-891cf6f32cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:05Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ad42e0-1d3b-48e3-991e-5a65db98d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ad42e0-1d3b-48e3-991e-5a65db98d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5b4eb1-143f-4988-80e2-44c8a8f2ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5b4eb1-143f-4988-80e2-44c8a8f2ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c794488a-6e57-496b-93f2-891cf6f32cc5', 'volume_name': 'volume-c794488a-6e57-496b-93f2-891cf6f32cc5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7fa88e-e94d-48c6-8b2f-d538a7ce2487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd7fa88e-e94d-48c6-8b2f-d538a7ce2487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c867a95-2e33-454b-b68a-36241329ed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Volume c794488a-6e57-496b-93f2-891cf6f32cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c794488a-6e57-496b-93f2-891cf6f32cc5', 'volume_size': 1} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2089484475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c794488a-6e57-496b-93f2-891cf6f32cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:05Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Creating volume c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:05 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 1073741824 Sep 28 17:27:05 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2dc47c-7e62-45e7-8669-9241b3575511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe', 'volume_name': 'volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe', 'volume_size': 1, 'image_id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6681d264ef62a04d32867affc3544d9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b104c136ddb14a5caa3e6779d2fafb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a789b927e03c287a20fc73091615380cfccad6e53f4bfdbe78c3a7b82593747f58c31e5110c2359ba1356d5909942673adbf922cbd034faa9c6d9d55779eb12', 'id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d21dff0-1885-4a07-a20d-8a7b16eb0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d21dff0-1885-4a07-a20d-8a7b16eb0e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edd281e-1fd8-4c77-b7c1-c9e0e6b4ad03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe', 'volume_size': 1, 'image_id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6681d264ef62a04d32867affc3544d9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b104c136ddb14a5caa3e6779d2fafb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a789b927e03c287a20fc73091615380cfccad6e53f4bfdbe78c3a7b82593747f58c31e5110c2359ba1356d5909942673adbf922cbd034faa9c6d9d55779eb12', 'id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2/file', 'properties': {}}, 'image_service': } Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Trying to clone 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe from image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}]). {{(pid=86842) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 17:27:05 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Image download 0.00 MB at 0.00 MB/s Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e9ff6-1dcc-4753-b5cc-cfb12abafbe6]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:05 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:05 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 1073741824" returned: 0 in 0.548s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:05 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 Sep 28 17:27:05 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:06 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5" returned: 0 in 0.285s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c867a95-2e33-454b-b68a-36241329ed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c794488a-6e57-496b-93f2-891cf6f32cc5', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:06 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:06 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8ff674-333e-46a0-a0c4-13bc945c35c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Volume volume-c794488a-6e57-496b-93f2-891cf6f32cc5 (c794488a-6e57-496b-93f2-891cf6f32cc5): created successfully Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d8ff674-333e-46a0-a0c4-13bc945c35c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (b17c802e-05a2-4469-a6ef-09e75f35a7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-df726d44-4111-4d25-86e3-66a39d9853ad tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:06 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Temporary image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 is fetched for user 391dff4c7aad48f9be8a99d5f45f8967. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5f5ac4-28b9-4974-a79a-3de072303529]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:06 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:06 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:06 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:06 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:07 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b104c136ddb14a5caa3e6779d2fafb87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:05Z,use_quota=True,user_id='391dff4c7aad48f9be8a99d5f45f8967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Creating volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:07 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:07 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1073741824 Sep 28 17:27:07 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:07 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1073741824" returned: 0 in 0.570s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:07 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe Sep 28 17:27:07 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" returned: 0 in 0.263s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.394s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 828afdd5-1528-46ac-bc75-ecaa2d88eedf of volume c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Attempting download of 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}])) to volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[876c95ff-b8bb-40f9-a22d-dab1b3ea8893]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[515d42f5-b09c-4566-b68d-654d11274a55]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 Sep 28 17:27:08 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj Sep 28 17:27:08 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5" returned: 0 in 0.458s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:08 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf 1G Sep 28 17:27:08 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[106458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj Sep 28 17:27:08 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:08 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj" returned: 1 in 0.354s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2_n0v69erj' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19eabee-d447-4d21-ab55-49520f3a66c2]: (4, 'raw') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:09 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf 1G" returned: 0 in 0.449s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c794488a-6e57-496b-93f2-891cf6f32cc5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c794488a-6e57-496b-93f2-891cf6f32cc5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf Sep 28 17:27:09 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 0 in 0.359s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c794488a-6e57-496b-93f2-891cf6f32cc5 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf" returned: 0 in 0.368s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD Sep 28 17:27:09 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf is being set with open permissions: ugo+rw Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf Sep 28 17:27:09 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (b5dc5124-ccce-4f62-a5e9-20aed7732371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6904303-cd52-44e6-8c9e-c4f63aa8c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6904303-cd52-44e6-8c9e-c4f63aa8c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942297576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f503167-6c09-400f-95ec-be5acf6dad96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:09Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984302c0-374c-45de-bb3b-cd59a1aade24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984302c0-374c-45de-bb3b-cd59a1aade24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b21234-23dc-4798-b119-08cf1c0cbf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8b21234-23dc-4798-b119-08cf1c0cbf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f503167-6c09-400f-95ec-be5acf6dad96', 'volume_name': 'volume-3f503167-6c09-400f-95ec-be5acf6dad96', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8dc48e-8a78-4de8-8925-18024dff5138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8dc48e-8a78-4de8-8925-18024dff5138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d49cba-1fff-4c2f-bd85-916ded38a54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:09 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Volume 3f503167-6c09-400f-95ec-be5acf6dad96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f503167-6c09-400f-95ec-be5acf6dad96', 'volume_size': 1} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:09 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 was raw, converting to qcow2 {{(pid=86842) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe Sep 28 17:27:09 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf" returned: 0 in 0.274s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:09 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info Sep 28 17:27:09 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:09 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info" returned: 0 in 0.264s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info is being set with open permissions: ugo+rw Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info Sep 28 17:27:10 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" returned: 0 in 0.468s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9f7982fc-cf32-4d19-ae2b-b3c6e51001a2__effq_n2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:27:10 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1G Sep 28 17:27:10 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.info" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942297576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f503167-6c09-400f-95ec-be5acf6dad96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:09Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Creating volume 3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:10 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 1073741824 Sep 28 17:27:10 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9c26a73c-0106-44d7-ba03-fd3c425e6809 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:27:10 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe 1G" returned: 0 in 0.389s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Downloaded image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}])) to volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe successfully. {{(pid=86842) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Temporary image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 for user 391dff4c7aad48f9be8a99d5f45f8967 is deleted. {{(pid=86842) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.volume_utils [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Marking volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe as bootable. {{(pid=86842) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Copying metadata from image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 to 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe. {{(pid=86842) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Creating volume glance metadata for volume 7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe backed by image 9f7982fc-cf32-4d19-ae2b-b3c6e51001a2 with: {'image_id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6681d264ef62a04d32867affc3544d9f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86842) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6edd281e-1fd8-4c77-b7c1-c9e0e6b4ad03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe', 'volume_size': 1, 'image_id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6681d264ef62a04d32867affc3544d9f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b104c136ddb14a5caa3e6779d2fafb87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a789b927e03c287a20fc73091615380cfccad6e53f4bfdbe78c3a7b82593747f58c31e5110c2359ba1356d5909942673adbf922cbd034faa9c6d9d55779eb12', 'id': '9f7982fc-cf32-4d19-ae2b-b3c6e51001a2', 'created_at': datetime.datetime(2026, 9, 28, 15, 27, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 15, 27, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9f7982fc-cf32-4d19-ae2b-b3c6e51001a2/file', 'properties': {}}, 'image_service': }' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42140b-6225-4d63-a912-a4211afb7827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:10 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Volume volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe (7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe): created successfully Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42140b-6225-4d63-a912-a4211afb7827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Flow 'volume_create_manager' (a24db6cd-5a04-431e-9f0c-05c26de8569b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-1a19409d-2fc5-40df-91bd-977dc6d843ec tempest-VolumeImageDependencyTests-858598276 None] Created volume successfully. Sep 28 17:27:10 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 1073741824" returned: 0 in 0.491s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-828afdd5-1528-46ac-bc75-ecaa2d88eedf-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-828afdd5-1528-46ac-bc75-ecaa2d88eedf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-828afdd5-1528-46ac-bc75-ecaa2d88eedf" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-828afdd5-1528-46ac-bc75-ecaa2d88eedf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 828afdd5-1528-46ac-bc75-ecaa2d88eedf of volume c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9d666-4d3e-41cf-877d-19db20f50a1b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:10 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 Sep 28 17:27:10 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf Sep 28 17:27:11 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96" returned: 0 in 0.250s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d49cba-1fff-4c2f-bd85-916ded38a54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f503167-6c09-400f-95ec-be5acf6dad96', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875cd025-35b0-4ff4-ba2a-16418dc3a51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:11 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Volume volume-3f503167-6c09-400f-95ec-be5acf6dad96 (3f503167-6c09-400f-95ec-be5acf6dad96): created successfully Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (875cd025-35b0-4ff4-ba2a-16418dc3a51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (b5dc5124-ccce-4f62-a5e9-20aed7732371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:11 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf" returned: 0 in 0.418s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c794488a-6e57-496b-93f2-891cf6f32cc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372af25-e678-4e2d-8cc8-32b0f7533153]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-ef634539-a27f-47ea-8727-0484c15150f5 tempest-ProjectReaderTests-599432600 None] Created volume successfully. Sep 28 17:27:11 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 Sep 28 17:27:11 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Acquiring lock "cinder-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "cinder-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Acquiring lock "cinder-quobyte-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "cinder-quobyte-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84d3988-6316-4688-97cb-5e3e0b0ad33e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5" returned: 0 in 0.407s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:11 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf Sep 28 17:27:11 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:11 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe Sep 28 17:27:11 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf" returned: 0 in 0.401s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" returned: 0 in 0.424s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf Sep 28 17:27:12 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe Sep 28 17:27:12 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Creating offline snapshot 51bb0ad1-b918-4519-bc99-ea54e2f99d34 of volume 3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702bf63-5afb-452e-99dc-47d19cad9b05]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 Sep 28 17:27:12 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:12 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5.828afdd5-1528-46ac-bc75-ecaa2d88eedf" returned: 0 in 0.265s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-828afdd5-1528-46ac-bc75-ecaa2d88eedf" released by "_delete_snapshot" :: held 1.613s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" released by "delete_snapshot" :: held 1.637s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "cinder-quobyte-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe" released by "delete_volume" :: held 0.772s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:12 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:12 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 1G Sep 28 17:27:12 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:13 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 1G" returned: 0 in 0.390s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f503167-6c09-400f-95ec-be5acf6dad96 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:13 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f503167-6c09-400f-95ec-be5acf6dad96 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 Sep 28 17:27:13 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Created reservations ['b385707a-395b-43b2-9368-e5e5635f8cf0', 'bc84f183-9b18-4818-953e-74365894f669', '08fe358d-6d62-4b27-9e63-db6e418c7ad1', '000d7428-f663-4b96-8bfb-6545d0d7fe11'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Created reservations ['ff9d2930-d71b-473c-858f-bdd800268bca', '5e18d7d4-e292-483a-9e91-6278792ddc90', '10e8b04b-25e5-42d4-898f-b6a1650c65a9', '08422b5d-3b5b-4332-8d0e-b9932652ceca'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:13 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f503167-6c09-400f-95ec-be5acf6dad96 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34" returned: 0 in 0.295s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:13 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 is being set with open permissions: ugo+rw Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:13 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 Sep 28 17:27:13 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:13 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34" returned: 0 in 0.241s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:15 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info Sep 28 17:27:15 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:15 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info" returned: 0 in 0.240s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:15 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info is being set with open permissions: ugo+rw Sep 28 17:27:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:15 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info Sep 28 17:27:15 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:15 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.info" returned: 0 in 0.239s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.296s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8191fcaa-0bd5-43f5-a2c8-252536bad062 tempest-ProjectReaderTests-599432600 None] Create snapshot completed successfully Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:17 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:17 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:17 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.248s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:17 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Deleted volume successfully. Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-51bb0ad1-b918-4519-bc99-ea54e2f99d34-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8e8afe3-76f2-4684-ba2c-be5b1ac8a375 tempest-VolumeImageDependencyTests-858598276 None] Lock "cinder-7b6804d4-6f26-4473-b1f4-6a6a81f2bbbe-delete_volume" released by "delete_volume" :: held 6.384s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-c794488a-6e57-496b-93f2-891cf6f32cc5-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-c794488a-6e57-496b-93f2-891cf6f32cc5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-51bb0ad1-b918-4519-bc99-ea54e2f99d34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-7b5a9686-cf7a-4dae-ad01-9cae32bbda7a tempest-ProjectMemberTests-1653911807 None] Lock "cinder-828afdd5-1528-46ac-bc75-ecaa2d88eedf-delete_snapshot" released by "delete_snapshot" :: held 7.259s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-51bb0ad1-b918-4519-bc99-ea54e2f99d34" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-51bb0ad1-b918-4519-bc99-ea54e2f99d34" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Deleting offline snapshot 51bb0ad1-b918-4519-bc99-ea54e2f99d34 of volume 3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] snapshot_file for this snap is: volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47341f2-2b33-4945-9099-e93e06ec0374]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" acquired by "delete_volume" :: waited 0.032s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef329d00-9c7c-4354-9804-8946641c6b9c]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 Sep 28 17:27:18 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 Sep 28 17:27:18 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34" returned: 0 in 0.436s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f503167-6c09-400f-95ec-be5acf6dad96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bcdeab-dfcb-4800-8779-0a0d73e0fc6e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5" returned: 0 in 0.434s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:18 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5 Sep 28 17:27:18 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:18 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 Sep 28 17:27:18 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-c794488a-6e57-496b-93f2-891cf6f32cc5" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-c794488a-6e57-496b-93f2-891cf6f32cc5" released by "delete_volume" :: held 0.807s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:19 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Created reservations ['65f1ec56-04eb-432e-a2ce-4c3dd9b3f8ff', '7045f76c-62a4-4f60-942a-12a1e587ad54', '361a81e3-3c9b-4ba8-890f-9f1a1a70d247', '5f5103c9-0bd9-4e93-9d5e-db75ea4d4d88'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:19 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 Sep 28 17:27:19 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:19 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:19 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:19 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34" returned: 0 in 0.496s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:19 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:27:19 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34 Sep 28 17:27:19 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-992c475e-ee77-4041-b3fd-8ffb7b748f52 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-c794488a-6e57-496b-93f2-891cf6f32cc5-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (98d87e89-6387-404f-8733-f50c42b34a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:19 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20ce90-ad84-4b3d-90ef-ebb204204abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96.51bb0ad1-b918-4519-bc99-ea54e2f99d34" returned: 0 in 0.318s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a20ce90-ad84-4b3d-90ef-ebb204204abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114077101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f00e9da-ae5c-459b-befb-e6ff10fa3232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:20Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4cab04-5aad-46b3-878f-8be61072a92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4cab04-5aad-46b3-878f-8be61072a92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6977a805-f091-41e0-9d77-657308d94c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6977a805-f091-41e0-9d77-657308d94c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f00e9da-ae5c-459b-befb-e6ff10fa3232', 'volume_name': 'volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5194443-ea1f-4da3-b504-6a7166b4e44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5194443-ea1f-4da3-b504-6a7166b4e44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21a321-4bd6-461a-8cf6-2e36b8725680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Volume 7f00e9da-ae5c-459b-befb-e6ff10fa3232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232', 'volume_size': 1} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-114077101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f00e9da-ae5c-459b-befb-e6ff10fa3232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:20Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Creating volume 7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:20 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-51bb0ad1-b918-4519-bc99-ea54e2f99d34" released by "_delete_snapshot" :: held 1.886s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" released by "delete_snapshot" :: held 1.944s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:20 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 1073741824 Sep 28 17:27:20 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Created reservations ['5c01a6e6-1c59-425f-a6e5-e37d3e00c9b9', 'f5c39492-c896-4b89-8a8c-5639e89d3f30', 'db5b33bb-cb25-4071-afed-6b2725800ac1', '8eeefed8-a87f-4a7e-bdd4-db166bd2532e'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Delete snapshot completed successfully. Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-20d00beb-210a-4ffa-a535-80bc1e5d8116 tempest-ProjectReaderTests-599432600 None] Lock "cinder-51bb0ad1-b918-4519-bc99-ea54e2f99d34-delete_snapshot" released by "delete_snapshot" :: held 2.137s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:20 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 1073741824" returned: 0 in 0.473s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:20 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 Sep 28 17:27:20 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:20 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232" returned: 0 in 0.259s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f21a321-4bd6-461a-8cf6-2e36b8725680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4ca84f-a149-4df3-b0b8-d2f00044abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Volume volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 (7f00e9da-ae5c-459b-befb-e6ff10fa3232): created successfully Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be4ca84f-a149-4df3-b0b8-d2f00044abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (98d87e89-6387-404f-8733-f50c42b34a0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-373afaec-71c5-4750-b139-36ca1761660f tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-3f503167-6c09-400f-95ec-be5acf6dad96-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "cinder-3f503167-6c09-400f-95ec-be5acf6dad96-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c6bbb2-0104-434b-8d37-23ef29fdd8a3]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 Sep 28 17:27:21 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:21 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96" returned: 0 in 0.423s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:21 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96 Sep 28 17:27:21 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-3f503167-6c09-400f-95ec-be5acf6dad96" returned: 0 in 0.295s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-3f503167-6c09-400f-95ec-be5acf6dad96" released by "delete_volume" :: held 0.798s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Created reservations ['ee974c6b-faf8-49b5-b76a-568eec57acf6', '560feaaa-32a8-4e6f-8ab2-5720f2fc2096', 'ca0e2691-e17c-411a-ad82-cdd08b4f0eb7', 'd1694f01-3bb1-4622-9c09-84fb787c4f0c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 52582e1e-43fe-4d85-ae5f-191d2c0a2de6 of volume 7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:22 devstack sudo[106613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:22 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b024c-a105-42b9-98da-b31ccd66b832]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 Sep 28 17:27:22 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.280s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:22 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Deleted volume successfully. Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6d60e62-82e3-4a52-ab21-48d418e4fe0e tempest-ProjectReaderTests-599432600 None] Lock "cinder-3f503167-6c09-400f-95ec-be5acf6dad96-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:22 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232" returned: 0 in 0.436s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:22 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 1G Sep 28 17:27:22 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (dc521953-8f3e-4115-85a1-f1f854f67153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb71d0ff-3330-493b-b946-80457b6e784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb71d0ff-3330-493b-b946-80457b6e784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448196805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e671ce83-c2e5-4ee0-bc10-dc41bf2fe800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:23Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f777c3f2-e9f0-4f09-9b02-30bdf797eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f777c3f2-e9f0-4f09-9b02-30bdf797eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04939519-9224-44f5-a76b-7df6c1ad0e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04939519-9224-44f5-a76b-7df6c1ad0e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e671ce83-c2e5-4ee0-bc10-dc41bf2fe800', 'volume_name': 'volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43182b85-8cf4-4e25-b517-de7e36eaaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43182b85-8cf4-4e25-b517-de7e36eaaa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c22122-1304-4df1-aea3-88a694609d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Volume e671ce83-c2e5-4ee0-bc10-dc41bf2fe800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800', 'volume_size': 1} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:23 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 1G" returned: 0 in 0.460s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 Sep 28 17:27:23 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6" returned: 0 in 0.330s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:23 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 is being set with open permissions: ugo+rw Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 Sep 28 17:27:23 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:23 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6" returned: 0 in 0.240s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:23 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info Sep 28 17:27:23 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info" returned: 0 in 0.307s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info is being set with open permissions: ugo+rw Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info Sep 28 17:27:24 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.info" returned: 0 in 0.265s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-448196805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e671ce83-c2e5-4ee0-bc10-dc41bf2fe800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:23Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Creating volume e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:24 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 1073741824 Sep 28 17:27:24 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:24 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-942cc84a-30d6-42e9-bef4-4746d4d9c6b8 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:27:24 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 1073741824" returned: 0 in 0.410s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:24 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 Sep 28 17:27:24 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" returned: 0 in 0.266s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c22122-1304-4df1-aea3-88a694609d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de0c327-6eb2-4270-b7e6-6c3bb6e2cb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:25 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Volume volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 (e671ce83-c2e5-4ee0-bc10-dc41bf2fe800): created successfully Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8de0c327-6eb2-4270-b7e6-6c3bb6e2cb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (dc521953-8f3e-4115-85a1-f1f854f67153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-fc29adc3-8109-49be-9915-a9d1ef212ec3 tempest-ProjectReaderTests-599432600 None] Created volume successfully. Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-52582e1e-43fe-4d85-ae5f-191d2c0a2de6-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-52582e1e-43fe-4d85-ae5f-191d2c0a2de6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-52582e1e-43fe-4d85-ae5f-191d2c0a2de6" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-52582e1e-43fe-4d85-ae5f-191d2c0a2de6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 52582e1e-43fe-4d85-ae5f-191d2c0a2de6 of volume 7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e55c471-919c-490a-953d-8cab7ecc9d5f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:25 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 Sep 28 17:27:25 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:25 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6" returned: 0 in 0.437s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[befa976b-92d5-45bd-9c87-c8c1626ccdf2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 Sep 28 17:27:26 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Creating offline snapshot 55e506eb-b715-4a6d-97c1-49438bad8385 of volume e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf25383-dd1e-4062-8c1e-57c0e33680ad]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232" returned: 0 in 0.450s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 Sep 28 17:27:26 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 Sep 28 17:27:26 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" returned: 0 in 0.368s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6" returned: 0 in 0.359s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:26 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 1G Sep 28 17:27:26 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:26 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6 Sep 28 17:27:26 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232.52582e1e-43fe-4d85-ae5f-191d2c0a2de6" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-52582e1e-43fe-4d85-ae5f-191d2c0a2de6" released by "_delete_snapshot" :: held 1.681s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" released by "delete_snapshot" :: held 1.712s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Created reservations ['9fabb135-a60a-4562-badc-5c7bc394561f', '4951883d-6d00-4b66-bcd9-395217030873', 'f7add4af-4ea2-42c1-a0dc-1dbd97c04520', '22b2a3dc-187a-4dac-86fe-4dcbb719356b'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:27 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 1G" returned: 0 in 0.502s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 Sep 28 17:27:27 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e3a0ba2e-974b-4b59-a220-f6ea0995e0c4 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-52582e1e-43fe-4d85-ae5f-191d2c0a2de6-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:27 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385" returned: 0 in 0.362s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 is being set with open permissions: ugo+rw Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-7f00e9da-ae5c-459b-befb-e6ff10fa3232-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:27 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 Sep 28 17:27:27 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-7f00e9da-ae5c-459b-befb-e6ff10fa3232-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f30e11-b8fb-4bf9-b97d-c46b0f776adb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:27 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:27 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 Sep 28 17:27:27 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info Sep 28 17:27:28 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info" returned: 0 in 0.334s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info is being set with open permissions: ugo+rw Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232" returned: 0 in 0.508s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info Sep 28 17:27:28 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232 Sep 28 17:27:28 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:28 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.info" returned: 0 in 0.300s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-7f00e9da-ae5c-459b-befb-e6ff10fa3232" returned: 0 in 0.316s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-7f00e9da-ae5c-459b-befb-e6ff10fa3232" released by "delete_volume" :: held 0.929s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e3a9ee4f-7734-4113-84af-d981a0ff5fd7 tempest-ProjectReaderTests-599432600 None] Create snapshot completed successfully Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Created reservations ['960e59e9-49af-4ac3-a9ac-88f57e62ddf8', '63ec2f04-1712-4801-8211-7b25fef825c4', '9c075414-f732-462f-9404-7a783c3572c1', 'dc82d1c8-8538-43b2-bbb7-2cd798778fc9'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:28 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:28 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:29 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.300s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:29 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a03699f4-fd41-496c-b628-9d95a08f9ef8 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-7f00e9da-ae5c-459b-befb-e6ff10fa3232-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-55e506eb-b715-4a6d-97c1-49438bad8385-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-55e506eb-b715-4a6d-97c1-49438bad8385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-55e506eb-b715-4a6d-97c1-49438bad8385" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-55e506eb-b715-4a6d-97c1-49438bad8385" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Deleting offline snapshot 55e506eb-b715-4a6d-97c1-49438bad8385 of volume e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] snapshot_file for this snap is: volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[53abd755-107a-496e-9872-a09b6e875578]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:29 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 Sep 28 17:27:29 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385" returned: 0 in 0.406s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9946d0-0ce0-47fc-a8bb-e0c00d832fa2]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 Sep 28 17:27:30 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (129fcc3a-10ac-4fa7-b1ba-bd3269b56f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034aa399-e062-4a1f-a712-193411f01180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034aa399-e062-4a1f-a712-193411f01180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820212122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f60f31-1bb6-4333-9f36-461eb57221d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:30Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13acac2f-7c88-40b1-8f14-dbeb0e9aef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13acac2f-7c88-40b1-8f14-dbeb0e9aef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634ba17e-4109-4fc4-985d-3e488e51b169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634ba17e-4109-4fc4-985d-3e488e51b169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f60f31-1bb6-4333-9f36-461eb57221d9', 'volume_name': 'volume-47f60f31-1bb6-4333-9f36-461eb57221d9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786e6ad-6b2f-432e-9dd4-f0cd3f3a9cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0786e6ad-6b2f-432e-9dd4-f0cd3f3a9cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4deaf16-c41b-4ca1-9716-09c5aed08b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:30 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Volume 47f60f31-1bb6-4333-9f36-461eb57221d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f60f31-1bb6-4333-9f36-461eb57221d9', 'volume_size': 1} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:30 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820212122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f60f31-1bb6-4333-9f36-461eb57221d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:30Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Creating volume 47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:30 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 1073741824 Sep 28 17:27:30 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 Sep 28 17:27:30 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385" returned: 0 in 0.336s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:30 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385 Sep 28 17:27:30 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:30 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 1073741824" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 Sep 28 17:27:31 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800.55e506eb-b715-4a6d-97c1-49438bad8385" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-55e506eb-b715-4a6d-97c1-49438bad8385" released by "_delete_snapshot" :: held 1.576s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" released by "delete_snapshot" :: held 1.600s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Created reservations ['2b8d4011-286a-4248-8a6e-d7629f90b08f', 'bc5eb89d-bee9-4aa5-adb4-86f7bcd41146', '830eda4c-3d4b-45d2-9aac-a2e2f5740783', '0352b0e6-fa02-4e8b-8e97-66cdc3a0068f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:31 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4deaf16-c41b-4ca1-9716-09c5aed08b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f60f31-1bb6-4333-9f36-461eb57221d9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235949cc-5bba-4014-9fe6-c416e6527abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:31 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Volume volume-47f60f31-1bb6-4333-9f36-461eb57221d9 (47f60f31-1bb6-4333-9f36-461eb57221d9): created successfully Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235949cc-5bba-4014-9fe6-c416e6527abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (129fcc3a-10ac-4fa7-b1ba-bd3269b56f28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6da30451-04a5-481c-884a-d36d63100419 tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Delete snapshot completed successfully. Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dd818e67-ce29-4f7b-8e3f-9e84a6cc2d23 tempest-ProjectReaderTests-599432600 None] Lock "cinder-55e506eb-b715-4a6d-97c1-49438bad8385-delete_snapshot" released by "delete_snapshot" :: held 1.786s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 4ce9e93f-f071-43c3-890d-f677fe0d2542 of volume 47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb87ce1-c893-468a-98d8-eda42998db6e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "cinder-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:31 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 Sep 28 17:27:31 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" acquired by "delete_volume" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d3bb17-3212-4a83-a5e4-0e5edce2ee85]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:31 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 Sep 28 17:27:31 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 1G Sep 28 17:27:32 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" returned: 0 in 0.360s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800 Sep 28 17:27:32 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" returned: 0 in 0.264s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 1G" returned: 0 in 0.429s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f60f31-1bb6-4333-9f36-461eb57221d9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800" released by "delete_volume" :: held 0.690s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:32 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f60f31-1bb6-4333-9f36-461eb57221d9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 Sep 28 17:27:32 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Created reservations ['271025ae-13f7-434c-a5e1-53e473917a36', 'cac2e48e-d424-4506-8ac6-5daf901da9f3', 'cd270cd8-fb5a-4a96-b4cd-1c0987ca9eee', 'ef3e6479-508e-4978-aaa5-6e75f74f8c01'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:32 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47f60f31-1bb6-4333-9f36-461eb57221d9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 is being set with open permissions: ugo+rw Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:32 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 Sep 28 17:27:32 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:32 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.261s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Deleted volume successfully. Sep 28 17:27:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-34a3ca3e-fdf4-4bdf-805e-93d971bd1bc3 tempest-ProjectReaderTests-599432600 None] Lock "cinder-e671ce83-c2e5-4ee0-bc10-dc41bf2fe800-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:33 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info Sep 28 17:27:33 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:33 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:33 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info is being set with open permissions: ugo+rw Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info Sep 28 17:27:33 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (c8ba9c4a-9dcb-4c36-bc6b-2f231dcdda9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cb13a9-1349-4a57-be1a-043c5d519051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cb13a9-1349-4a57-be1a-043c5d519051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103799291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccdc117-6b98-43b5-88d9-85aeb9e82f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:33Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099f387-272e-47ae-a830-8a3c2c2c7fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d099f387-272e-47ae-a830-8a3c2c2c7fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4124f-b869-448e-bd9d-4279bc88f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18f4124f-b869-448e-bd9d-4279bc88f031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bccdc117-6b98-43b5-88d9-85aeb9e82f04', 'volume_name': 'volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22e9836-b10c-44bd-a989-0f1ace4a744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22e9836-b10c-44bd-a989-0f1ace4a744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00be31ca-542b-4993-92a9-86c4cfddb14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:33 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Volume bccdc117-6b98-43b5-88d9-85aeb9e82f04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04', 'volume_size': 1} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:33 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.info" returned: 0 in 0.303s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1103799291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bccdc117-6b98-43b5-88d9-85aeb9e82f04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:33Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Creating volume bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:33 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:33 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:33 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 1073741824 Sep 28 17:27:33 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:33 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b9bbfde3-b449-4eae-b0b9-f19041230b89 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:27:34 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 1073741824" returned: 0 in 0.413s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 Sep 28 17:27:34 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:34 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04" returned: 0 in 0.245s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00be31ca-542b-4993-92a9-86c4cfddb14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d21f76-2ef2-487d-8d87-c0f8c1f0c65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:34 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Volume volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 (bccdc117-6b98-43b5-88d9-85aeb9e82f04): created successfully Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d21f76-2ef2-487d-8d87-c0f8c1f0c65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (c8ba9c4a-9dcb-4c36-bc6b-2f231dcdda9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:34 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e880ff15-e2d2-4081-8729-7050886c7e67 tempest-ProjectReaderTests-599432600 None] Created volume successfully. Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-4ce9e93f-f071-43c3-890d-f677fe0d2542-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-4ce9e93f-f071-43c3-890d-f677fe0d2542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-4ce9e93f-f071-43c3-890d-f677fe0d2542" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-4ce9e93f-f071-43c3-890d-f677fe0d2542" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 4ce9e93f-f071-43c3-890d-f677fe0d2542 of volume 47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d88730-9765-4f37-88f9-fba5f763a91e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:34 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:34 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 Sep 28 17:27:34 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542" returned: 0 in 0.352s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47f60f31-1bb6-4333-9f36-461eb57221d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a7c221-0ca7-4e26-9989-6af8bbc907eb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 Sep 28 17:27:35 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Creating offline snapshot 138da25c-5d43-47b7-8f2d-58487b82a8e5 of volume bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:35 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9" returned: 0 in 0.418s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29bdb68-e38f-4d04-9fc9-29fe0102a654]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:35 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:35 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 Sep 28 17:27:35 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:35 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 Sep 28 17:27:35 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542" returned: 0 in 0.353s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542 Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 1G Sep 28 17:27:36 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9.4ce9e93f-f071-43c3-890d-f677fe0d2542" returned: 0 in 0.246s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-4ce9e93f-f071-43c3-890d-f677fe0d2542" released by "_delete_snapshot" :: held 1.472s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" released by "delete_snapshot" :: held 1.493s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Created reservations ['24e2871e-3b4e-4e1b-9fa1-8c5d72366d72', '0212379d-8460-4d4d-b078-4f1edea1b21a', 'a995f561-7091-4022-8101-5be8881c14c9', '10f5c07e-9f7b-4ee8-aeb9-defd2a011ff8'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:36 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-e12274a6-f8c0-4cfb-bb0e-977ead2eb3a2 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-4ce9e93f-f071-43c3-890d-f677fe0d2542-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:36 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 1G" returned: 0 in 0.447s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 Sep 28 17:27:36 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5" returned: 0 in 0.302s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:36 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 is being set with open permissions: ugo+rw Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:36 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 Sep 28 17:27:36 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-47f60f31-1bb6-4333-9f36-461eb57221d9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:36 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-47f60f31-1bb6-4333-9f36-461eb57221d9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[24123a49-6ad7-408b-be3b-2f87b92059ab]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info Sep 28 17:27:37 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 Sep 28 17:27:37 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info" returned: 0 in 0.290s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info is being set with open permissions: ugo+rw Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info Sep 28 17:27:37 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9" returned: 0 in 0.449s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9 Sep 28 17:27:37 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:37 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.info" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.038s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:37 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-7c55c994-6b43-45d6-a31a-9e73a9a54997 tempest-ProjectReaderTests-599432600 None] Create snapshot completed successfully Sep 28 17:27:37 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-47f60f31-1bb6-4333-9f36-461eb57221d9" returned: 0 in 0.269s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-47f60f31-1bb6-4333-9f36-461eb57221d9" released by "delete_volume" :: held 0.791s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Created reservations ['6799b221-2f90-408e-ace9-db0d42fd84cc', 'cea4b06d-b6df-41b0-9d20-c78a6e9b380d', '875065b8-e447-4368-bbdf-9a7564472870', 'd7d433cd-d643-41e5-b15a-437059df1c05'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:37 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:37 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:37 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.255s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:38 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-af9bea9d-472b-43aa-a365-ecf2c7a06e61 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-47f60f31-1bb6-4333-9f36-461eb57221d9-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (0a287ca6-addc-420a-9f51-cc4bf4dbccac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ef47dc-ba41-47a1-827c-8ba5a73d3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ef47dc-ba41-47a1-827c-8ba5a73d3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092729728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9465575c-8b38-4b5f-b9c8-b59a4876044c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:39Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0ae44a-0ad7-412a-932f-246d97493d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e0ae44a-0ad7-412a-932f-246d97493d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aec3fc-d66b-43e9-bb8e-02481671e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89aec3fc-d66b-43e9-bb8e-02481671e353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9465575c-8b38-4b5f-b9c8-b59a4876044c', 'volume_name': 'volume-9465575c-8b38-4b5f-b9c8-b59a4876044c', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a486c2a8-7e3a-41f4-a1bd-6dc706d75c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a486c2a8-7e3a-41f4-a1bd-6dc706d75c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf97ce-6f29-4d0e-a2eb-8d9ee7a67edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:38 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Volume 9465575c-8b38-4b5f-b9c8-b59a4876044c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9465575c-8b38-4b5f-b9c8-b59a4876044c', 'volume_size': 1} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2092729728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9465575c-8b38-4b5f-b9c8-b59a4876044c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:39Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Creating volume 9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:38 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:38 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c 1073741824 Sep 28 17:27:38 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-138da25c-5d43-47b7-8f2d-58487b82a8e5-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-138da25c-5d43-47b7-8f2d-58487b82a8e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-138da25c-5d43-47b7-8f2d-58487b82a8e5" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-138da25c-5d43-47b7-8f2d-58487b82a8e5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Deleting offline snapshot 138da25c-5d43-47b7-8f2d-58487b82a8e5 of volume bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] snapshot_file for this snap is: volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63cb704-a68c-44f3-a96c-a782e8428819]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:38 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 Sep 28 17:27:39 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c 1073741824" returned: 0 in 0.443s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c Sep 28 17:27:39 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5" returned: 0 in 0.403s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c545b4-f7c2-4bb4-b360-658222dcd590]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c" returned: 0 in 0.259s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf97ce-6f29-4d0e-a2eb-8d9ee7a67edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9465575c-8b38-4b5f-b9c8-b59a4876044c', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66370a4f-c2fe-49b0-a019-6560de4df516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:39 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 Sep 28 17:27:39 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Volume volume-9465575c-8b38-4b5f-b9c8-b59a4876044c (9465575c-8b38-4b5f-b9c8-b59a4876044c): created successfully Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66370a4f-c2fe-49b0-a019-6560de4df516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (0a287ca6-addc-420a-9f51-cc4bf4dbccac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:39 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-23f70107-d466-4770-b373-6a17f3ab3f7b tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:39 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04" returned: 0 in 0.376s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 Sep 28 17:27:39 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 670802f7-6dc7-43ad-b199-b4ecd019dd8e of volume 9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1db506-f9f3-4fcb-835e-fdbeaa41fd1a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:39 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:39 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c Sep 28 17:27:39 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5 Sep 28 17:27:40 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c" returned: 0 in 0.399s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e 1G Sep 28 17:27:40 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04.138da25c-5d43-47b7-8f2d-58487b82a8e5" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-138da25c-5d43-47b7-8f2d-58487b82a8e5" released by "_delete_snapshot" :: held 1.493s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" released by "delete_snapshot" :: held 1.519s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Created reservations ['fdbf4312-657b-473c-8e3b-9148f55f6206', 'ea6e40e6-46a7-4be2-ae2f-a437e18fee03', '92996d61-26ae-42b1-9d78-f8e34e883e44', '59f254b9-f1e1-454e-87f8-6f4fa7c6a598'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:40 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Delete snapshot completed successfully. Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6f61a7ff-3ba6-4c1f-b9da-6557cb8d5075 tempest-ProjectReaderTests-599432600 None] Lock "cinder-138da25c-5d43-47b7-8f2d-58487b82a8e5-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:40 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e 1G" returned: 0 in 0.439s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9465575c-8b38-4b5f-b9c8-b59a4876044c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9465575c-8b38-4b5f-b9c8-b59a4876044c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e Sep 28 17:27:40 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9465575c-8b38-4b5f-b9c8-b59a4876044c -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e" returned: 0 in 0.297s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:40 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e is being set with open permissions: ugo+rw Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:40 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e Sep 28 17:27:40 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:40 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-bccdc117-6b98-43b5-88d9-85aeb9e82f04-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "cinder-bccdc117-6b98-43b5-88d9-85aeb9e82f04-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" acquired by "delete_volume" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe08d73-7e37-4c2c-a247-0e317eb6a8b6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 Sep 28 17:27:41 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info Sep 28 17:27:41 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info" returned: 0 in 0.249s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info is being set with open permissions: ugo+rw Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04" returned: 0 in 0.418s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:41 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info Sep 28 17:27:41 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04 Sep 28 17:27:41 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:41 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.info" returned: 0 in 0.286s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-bccdc117-6b98-43b5-88d9-85aeb9e82f04" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-bccdc117-6b98-43b5-88d9-85aeb9e82f04" released by "delete_volume" :: held 0.782s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:41 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2d3c9029-a011-4e3e-8e18-e062629b123a tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Created reservations ['ebe69efc-5064-4901-89c8-8bae9602a316', 'e91425a1-0589-46b2-bd85-5b6198c1d736', 'b322beb6-6baf-40cc-a3c6-2ee8e8b6b6e5', '23f61d44-50b5-45a9-80b7-136318f74b8a'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:41 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:42 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:42 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:42 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:42 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Deleted volume successfully. Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-0db7d589-8bc8-464c-adeb-ee2701194685 tempest-ProjectReaderTests-599432600 None] Lock "cinder-bccdc117-6b98-43b5-88d9-85aeb9e82f04-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (859102f9-5515-4b76-af9d-9ee908d66751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e685fd2-83fe-4c19-b4bc-dc33448ab7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e685fd2-83fe-4c19-b4bc-dc33448ab7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415601743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:43Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0186d2db-98e1-4aa6-a3ff-f8be6996374a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0186d2db-98e1-4aa6-a3ff-f8be6996374a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99106ef6-fce4-4533-abd6-a4ce17004a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99106ef6-fce4-4533-abd6-a4ce17004a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e8f53e-bfdf-4881-aa93-53d1ae0a14f9', 'volume_name': 'volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc28d739-55fa-49d2-9530-226a69b11d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc28d739-55fa-49d2-9530-226a69b11d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092ccaec-3cd2-48ee-bdbe-102006767f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:42 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Volume d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9', 'volume_size': 1} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415601743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:43Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Creating volume d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:42 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:42 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 1073741824 Sep 28 17:27:42 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-670802f7-6dc7-43ad-b199-b4ecd019dd8e-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-670802f7-6dc7-43ad-b199-b4ecd019dd8e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:42 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-670802f7-6dc7-43ad-b199-b4ecd019dd8e" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-670802f7-6dc7-43ad-b199-b4ecd019dd8e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 670802f7-6dc7-43ad-b199-b4ecd019dd8e of volume 9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd071a3a-85ad-4ab9-81f3-8573ef360667]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e Sep 28 17:27:43 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 1073741824" returned: 0 in 0.456s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 Sep 28 17:27:43 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e" returned: 0 in 0.367s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9465575c-8b38-4b5f-b9c8-b59a4876044c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[701233e1-5cd9-4d7e-8191-2f3d7ad4d5d1]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" returned: 0 in 0.262s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092ccaec-3cd2-48ee-bdbe-102006767f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044cc0a4-9efd-4676-ba75-cd8d2c5f7a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:43 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Volume volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 (d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9): created successfully Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (044cc0a4-9efd-4676-ba75-cd8d2c5f7a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:43 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c Sep 28 17:27:43 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (859102f9-5515-4b76-af9d-9ee908d66751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:43 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d9b68c36-6fcf-4fec-bbba-b31f99e9a25b tempest-ProjectReaderTests-599432600 None] Created volume successfully. Sep 28 17:27:43 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c" returned: 0 in 0.417s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:43 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e Sep 28 17:27:43 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Creating offline snapshot 773147ee-fa87-4e8f-b3dd-05e90c7f0bcb of volume d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ef1737-5827-4415-b624-ca85ef49e7cb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:43 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 Sep 28 17:27:44 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e" returned: 0 in 0.366s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e Sep 28 17:27:44 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" returned: 0 in 0.396s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb 1G Sep 28 17:27:44 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c.670802f7-6dc7-43ad-b199-b4ecd019dd8e" returned: 0 in 0.293s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:44 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-670802f7-6dc7-43ad-b199-b4ecd019dd8e" released by "_delete_snapshot" :: held 1.584s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" released by "delete_snapshot" :: held 1.616s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Created reservations ['b41b957c-b9f4-450d-ac27-a3c62b950561', '88415694-7ee9-4991-a561-313964d329f6', '304f0de9-ba82-48f8-9213-2d4fbd3c9439', '104b2a84-fab3-44da-a322-a197474f9fef'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:44 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-31d9fa06-a1b9-4105-ad9b-75269ec28561 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-670802f7-6dc7-43ad-b199-b4ecd019dd8e-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:44 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.308s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb 1G" returned: 0 in 0.513s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:27:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:27:44 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb Sep 28 17:27:44 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-9465575c-8b38-4b5f-b9c8-b59a4876044c-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-9465575c-8b38-4b5f-b9c8-b59a4876044c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:45 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" returned: 0 in 0.405s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb is being set with open permissions: ugo+rw Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b4a45-c718-422b-9d0a-f26244a089e6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb Sep 28 17:27:45 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c Sep 28 17:27:45 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" returned: 0 in 0.253s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info Sep 28 17:27:45 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c" returned: 0 in 0.411s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c Sep 28 17:27:45 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info" returned: 0 in 0.263s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info is being set with open permissions: ugo+rw Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:45 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info Sep 28 17:27:45 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:45 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-9465575c-8b38-4b5f-b9c8-b59a4876044c" returned: 0 in 0.283s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:45 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-9465575c-8b38-4b5f-b9c8-b59a4876044c" released by "delete_volume" :: held 0.765s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Created reservations ['53c24b4a-27fc-44eb-8348-fcf17f85e0e8', '2388062b-13e0-4449-9a85-8565c8e1c650', '23b94d95-8399-4dbf-adc3-1a65f3eb48e2', '4bc7a48d-0bf5-4249-a745-5658a5233dca'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:46 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.info" returned: 0 in 0.270s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-0e035675-b322-41ed-b87a-870b3c5b3bda tempest-ProjectReaderTests-599432600 None] Create snapshot completed successfully Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:46 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:46 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:46 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d77844ff-4898-46a3-8f8a-cab0fbb53d92 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-9465575c-8b38-4b5f-b9c8-b59a4876044c-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (d9584218-bb40-4407-bc72-e1b822192c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f0eefc-cd05-4343-aa81-835282fe66b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f0eefc-cd05-4343-aa81-835282fe66b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-3773833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d21e5-d03c-47c7-b4d4-373c5eeb2c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:47Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c11740d-aae3-4213-a2b4-0d07d34a57ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c11740d-aae3-4213-a2b4-0d07d34a57ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05604457-9039-4058-bf53-07215b5edfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05604457-9039-4058-bf53-07215b5edfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd51d21e5-d03c-47c7-b4d4-373c5eeb2c85', 'volume_name': 'volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fc71ff-bb66-43c1-a0a3-3e266eb5fff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7fc71ff-bb66-43c1-a0a3-3e266eb5fff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd73ee0-2de7-4280-a9a2-95b8d769e0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:46 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Volume d51d21e5-d03c-47c7-b4d4-373c5eeb2c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85', 'volume_size': 1} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-3773833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d51d21e5-d03c-47c7-b4d4-373c5eeb2c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:47Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Creating volume d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:46 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:46 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:46 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 1073741824 Sep 28 17:27:46 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Deleting offline snapshot 773147ee-fa87-4e8f-b3dd-05e90c7f0bcb of volume d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] snapshot_file for this snap is: volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a7d28-c5cd-4c1d-921d-30de392e2dde]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb Sep 28 17:27:47 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 1073741824" returned: 0 in 0.499s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 Sep 28 17:27:47 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" returned: 0 in 0.407s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed74290-c4c1-41b4-9de1-918537cf3a46]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 Sep 28 17:27:47 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:47 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd73ee0-2de7-4280-a9a2-95b8d769e0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7df4f4-3980-4213-b868-c09ecf4a35bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:47 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Volume volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 (d51d21e5-d03c-47c7-b4d4-373c5eeb2c85): created successfully Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7df4f4-3980-4213-b868-c09ecf4a35bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (d9584218-bb40-4407-bc72-e1b822192c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:47 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6dc14226-37f4-4b06-a988-7309097f8d9e tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:47 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" returned: 0 in 0.381s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:47 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:47 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb Sep 28 17:27:47 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" returned: 0 in 0.354s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:48 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb Sep 28 17:27:48 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:48 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9.773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb" released by "_delete_snapshot" :: held 1.548s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" released by "delete_snapshot" :: held 1.571s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Created reservations ['dc6ede5e-07f4-47f4-b73c-a136084185b3', 'e00dcbca-6faa-47c1-a04a-54159fd9b157', 'a7ff4a41-e489-4999-9a4a-0b62a6f74b05', '9c5deeec-ac56-4964-81e3-48e816bd263f'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:48 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Delete snapshot completed successfully. Sep 28 17:27:48 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d394f4a-5646-49c8-9c26-0c4268c32f26 tempest-ProjectReaderTests-599432600 None] Lock "cinder-773147ee-fa87-4e8f-b3dd-05e90c7f0bcb-delete_snapshot" released by "delete_snapshot" :: held 1.727s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 2612f95e-3a50-435d-b160-819c07ccc099 of volume d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6ebaa8-383e-4e63-89a5-029925a706dc]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 Sep 28 17:27:49 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "cinder-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00747f-2e4d-4380-8cc9-123fac17060e]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 Sep 28 17:27:49 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" returned: 0 in 0.409s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 1G Sep 28 17:27:49 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" returned: 0 in 0.388s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9 Sep 28 17:27:49 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:49 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 1G" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:49 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:49 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 Sep 28 17:27:49 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" returned: 0 in 0.267s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9" released by "delete_volume" :: held 0.722s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Created reservations ['e16416fa-a80f-48b7-ab6e-128129a3f333', 'fd9045c9-76b9-479d-9dea-8fb6f2149022', '4f850d74-edf2-4253-9ad1-5d99f75eb394', '3aae0acd-087c-483d-ae63-8bcabc1c0b52'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:50 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099" returned: 0 in 0.312s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 is being set with open permissions: ugo+rw Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 Sep 28 17:27:50 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.288s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:50 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Deleted volume successfully. Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4bf249cc-1dbd-4d53-93ef-1852071f9fba tempest-ProjectReaderTests-599432600 None] Lock "cinder-d0e8f53e-bfdf-4881-aa93-53d1ae0a14f9-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:50 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099" returned: 0 in 0.262s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info Sep 28 17:27:50 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info" returned: 0 in 0.293s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:50 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info is being set with open permissions: ugo+rw Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:50 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info Sep 28 17:27:50 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (0af8e504-2d12-4a03-90eb-48a08b833922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b0eaff-0dd1-4b8d-a368-3216826aa6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b0eaff-0dd1-4b8d-a368-3216826aa6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062445123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79759003-01ab-45a8-aea0-b296b6a5a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:51Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e86433-2305-4934-a2be-0b4877f93e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e86433-2305-4934-a2be-0b4877f93e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb183869-cfd6-490b-b7aa-af0a1d0539a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb183869-cfd6-490b-b7aa-af0a1d0539a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79759003-01ab-45a8-aea0-b296b6a5a554', 'volume_name': 'volume-79759003-01ab-45a8-aea0-b296b6a5a554', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0081c5df-2eab-484e-8c80-3329a5556fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0081c5df-2eab-484e-8c80-3329a5556fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1505a358-d3cb-4b17-8ac5-a1479acc8c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:50 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Volume 79759003-01ab-45a8-aea0-b296b6a5a554: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79759003-01ab-45a8-aea0-b296b6a5a554', 'volume_size': 1} Sep 28 17:27:50 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:51 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.info" returned: 0 in 0.232s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.134s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2062445123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79759003-01ab-45a8-aea0-b296b6a5a554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='214ee728edda454eb724e6d260d7d7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:51Z,use_quota=True,user_id='e3eff8d15f48469fb199a05594ae0647',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Creating volume 79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:51 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 1073741824 Sep 28 17:27:51 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-50b852ac-21d3-454f-ab38-fbc329c0c603 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:27:51 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 1073741824" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:51 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 Sep 28 17:27:51 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:51 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554" returned: 0 in 0.254s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1505a358-d3cb-4b17-8ac5-a1479acc8c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79759003-01ab-45a8-aea0-b296b6a5a554', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e1c4c-f4b5-4742-ae2a-c8cafd4b1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:51 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Volume volume-79759003-01ab-45a8-aea0-b296b6a5a554 (79759003-01ab-45a8-aea0-b296b6a5a554): created successfully Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754e1c4c-f4b5-4742-ae2a-c8cafd4b1936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:51 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Flow 'volume_create_manager' (0af8e504-2d12-4a03-90eb-48a08b833922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:51 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b19b5744-e871-4316-8d9c-372753d4fd07 tempest-ProjectReaderTests-599432600 None] Created volume successfully. Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-2612f95e-3a50-435d-b160-819c07ccc099-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-2612f95e-3a50-435d-b160-819c07ccc099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-2612f95e-3a50-435d-b160-819c07ccc099" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-2612f95e-3a50-435d-b160-819c07ccc099" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 2612f95e-3a50-435d-b160-819c07ccc099 of volume d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deef21a-2f66-478c-a17b-30f99e863b59]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 Sep 28 17:27:52 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:52 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099" returned: 0 in 0.371s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe968092-0ac1-473e-9950-6e62abebf7b6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:52 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:52 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 Sep 28 17:27:52 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Creating offline snapshot 18fe7551-ec29-4b15-b077-e774807f7b43 of volume 79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:53 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd5d475-0d0b-4423-a1e0-8ea8449b4efb]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 Sep 28 17:27:53 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 Sep 28 17:27:53 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099 Sep 28 17:27:53 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:53 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 1G Sep 28 17:27:53 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:53 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85.2612f95e-3a50-435d-b160-819c07ccc099" returned: 0 in 0.250s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-2612f95e-3a50-435d-b160-819c07ccc099" released by "_delete_snapshot" :: held 1.486s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" released by "delete_snapshot" :: held 1.509s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Created reservations ['98f6a244-9012-4df8-a859-1936718b9427', '0cd7b715-2bc9-4394-ab51-3b7a758373ce', 'cc06b950-4f3f-4977-bd6d-1f45be5e2c9d', 'af0df479-5353-4bb9-a5c1-d1b37a302472'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:53 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:27:53 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b1e0aa3d-df4f-4ef3-ba4a-598fc2d81261 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-2612f95e-3a50-435d-b160-819c07ccc099-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:54 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 1G" returned: 0 in 0.417s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79759003-01ab-45a8-aea0-b296b6a5a554 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79759003-01ab-45a8-aea0-b296b6a5a554 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 Sep 28 17:27:54 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79759003-01ab-45a8-aea0-b296b6a5a554 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43" returned: 0 in 0.281s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 is being set with open permissions: ugo+rw Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 Sep 28 17:27:54 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:54 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[d517bf9d-dae5-4a4b-b4bf-0bc97bc098f6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info Sep 28 17:27:54 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 Sep 28 17:27:54 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info" returned: 0 in 0.259s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info is being set with open permissions: ugo+rw Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info Sep 28 17:27:54 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:54 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" returned: 0 in 0.365s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:54 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:54 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85 Sep 28 17:27:54 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.info" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-e13ca620-e9e7-43a2-8c77-ec5aee0f36e2 tempest-ProjectReaderTests-599432600 None] Create snapshot completed successfully Sep 28 17:27:55 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" returned: 0 in 0.254s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85" released by "delete_volume" :: held 0.696s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Created reservations ['8b712f46-667a-49c7-a52c-0f38b1c65cc4', '5dec1f54-fbc5-40c7-90c1-92046944f236', '27cdf20c-31d4-4dda-a54c-93da72bba9f2', '0c9756a7-934f-414a-abf2-804daa3bcc16'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=197,cinder:SELECT=170,cinder:DELETE=23,cinder:INSERT=65 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-18fe7551-ec29-4b15-b077-e774807f7b43-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-18fe7551-ec29-4b15-b077-e774807f7b43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-18fe7551-ec29-4b15-b077-e774807f7b43" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-18fe7551-ec29-4b15-b077-e774807f7b43" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Deleting offline snapshot 18fe7551-ec29-4b15-b077-e774807f7b43 of volume 79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:27:55 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:55 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] snapshot_file for this snap is: volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[707cc0b7-2281-47e6-9744-33492b380e75]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 Sep 28 17:27:55 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:55 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.259s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:55 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a9a9badc-f888-4349-ba20-8da37b7d9a2e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-d51d21e5-d03c-47c7-b4d4-373c5eeb2c85-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:55 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79759003-01ab-45a8-aea0-b296b6a5a554(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d202cbb-f99d-4ed0-9d67-405db2f7e374]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:55 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:55 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 Sep 28 17:27:55 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554" returned: 0 in 0.398s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 Sep 28 17:27:56 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (8c2ac933-3853-4117-bfba-dcde0a96ec7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95691484-2924-4147-890e-682abcdeaaa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95691484-2924-4147-890e-682abcdeaaa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128875942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85f480b-3c71-453b-a848-23b8b0fb7102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:56Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05f2692-a668-4dc7-abaa-12381972c42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05f2692-a668-4dc7-abaa-12381972c42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11ee2c7-3c60-487e-8a22-33418e101adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11ee2c7-3c60-487e-8a22-33418e101adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85f480b-3c71-453b-a848-23b8b0fb7102', 'volume_name': 'volume-e85f480b-3c71-453b-a848-23b8b0fb7102', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6dc609-fc66-44a8-a60d-994bba11f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6dc609-fc66-44a8-a60d-994bba11f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0445fa43-688c-4b83-9cd5-3d12404064b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:56 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Volume e85f480b-3c71-453b-a848-23b8b0fb7102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85f480b-3c71-453b-a848-23b8b0fb7102', 'volume_size': 1} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2128875942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85f480b-3c71-453b-a848-23b8b0fb7102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:27:56Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Creating volume e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:27:56 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 1073741824 Sep 28 17:27:56 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43" returned: 0 in 0.373s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43 Sep 28 17:27:56 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 1073741824" returned: 0 in 0.435s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=166,cinder:INSERT=57,cinder:UPDATE=222,cinder:DELETE=11 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:27:56 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554.18fe7551-ec29-4b15-b077-e774807f7b43" returned: 0 in 0.258s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-18fe7551-ec29-4b15-b077-e774807f7b43" released by "_delete_snapshot" :: held 1.538s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" released by "delete_snapshot" :: held 1.596s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:56 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 Sep 28 17:27:56 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:56 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Created reservations ['11642c84-b310-4355-b2d4-6d8407c92e54', '1be32b8e-9ca2-4bd5-ad64-cc7628207789', 'e45ca2f5-7060-4a85-93d0-f578479c9218', 'e54a985d-c25f-499f-82ae-c408169d1b8d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Delete snapshot completed successfully. Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-9f4a21ac-0925-4095-9b62-abf00c2f9700 tempest-ProjectReaderTests-599432600 None] Lock "cinder-18fe7551-ec29-4b15-b077-e774807f7b43-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:57 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102" returned: 0 in 0.257s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0445fa43-688c-4b83-9cd5-3d12404064b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85f480b-3c71-453b-a848-23b8b0fb7102', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba82647-c79f-4c1d-9e41-a9accef4cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:27:57 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Volume volume-e85f480b-3c71-453b-a848-23b8b0fb7102 (e85f480b-3c71-453b-a848-23b8b0fb7102): created successfully Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba82647-c79f-4c1d-9e41-a9accef4cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (8c2ac933-3853-4117-bfba-dcde0a96ec7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:27:57 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a5050977-8881-40d2-808a-e5b5228d3a91 tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-79759003-01ab-45a8-aea0-b296b6a5a554-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "cinder-79759003-01ab-45a8-aea0-b296b6a5a554-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Acquiring lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d59ef5-c484-44e9-8052-7eb8a617862f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 Sep 28 17:27:57 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:57 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554" returned: 0 in 0.366s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:57 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:57 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554 Sep 28 17:27:57 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-79759003-01ab-45a8-aea0-b296b6a5a554" returned: 0 in 0.249s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "cinder-quobyte-79759003-01ab-45a8-aea0-b296b6a5a554" released by "delete_volume" :: held 0.681s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Created reservations ['aac46045-800d-4121-ad0d-181dca7dc3ce', '12212a48-65be-4dbb-9202-e493c6efd15d', 'a5aa12ab-e493-44af-bd8a-a0e864477ffb', '6d93d790-2609-4e49-8f07-9f56cbeda582'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:27:58 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:27:58 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 29fdd726-336f-48c5-918b-786b8f694fa3 of volume e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.307s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:27:58 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Deleted volume successfully. Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e48b5be-4550-430f-9cb8-635d113aa462]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:58 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d9fea42a-23b4-418b-b398-2ac491c0b924 tempest-ProjectReaderTests-599432600 None] Lock "cinder-79759003-01ab-45a8-aea0-b296b6a5a554-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:27:58 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 Sep 28 17:27:58 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:59 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102" returned: 0 in 0.395s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:59 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 1G Sep 28 17:27:59 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:59 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 1G" returned: 0 in 0.454s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85f480b-3c71-453b-a848-23b8b0fb7102 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:59 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85f480b-3c71-453b-a848-23b8b0fb7102 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 Sep 28 17:27:59 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:27:59 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85f480b-3c71-453b-a848-23b8b0fb7102 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3" returned: 0 in 0.357s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:27:59 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 is being set with open permissions: ugo+rw Sep 28 17:27:59 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:27:59 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 Sep 28 17:27:59 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3" returned: 0 in 0.268s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:00 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info Sep 28 17:28:00 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info" returned: 0 in 0.285s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info is being set with open permissions: ugo+rw Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:00 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info Sep 28 17:28:00 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:00 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.info" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:00 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:00 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-42ef4491-6b7b-4d19-a30d-a2a6a8764baf tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-29fdd726-336f-48c5-918b-786b8f694fa3-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-29fdd726-336f-48c5-918b-786b8f694fa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-29fdd726-336f-48c5-918b-786b8f694fa3" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-29fdd726-336f-48c5-918b-786b8f694fa3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 29fdd726-336f-48c5-918b-786b8f694fa3 of volume e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f52f2-9be2-44ef-a8e4-ad8e05ff504b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:01 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 Sep 28 17:28:02 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3" returned: 0 in 0.425s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e85f480b-3c71-453b-a848-23b8b0fb7102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd393e-245f-43f9-95ee-39f5c4abc351]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 Sep 28 17:28:02 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102" returned: 0 in 0.438s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 Sep 28 17:28:02 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Flow 'volume_create_manager' (c0cf2602-d5a0-4d68-bbbc-c8ef5700c62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d03aca1-3c58-4533-84ad-dc3207f3a4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d03aca1-3c58-4533-84ad-dc3207f3a4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052404766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b96a9-c13f-48eb-af7f-09f64c6a0b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea219d62383649dfae82cd267054c297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:03Z,use_quota=True,user_id='2cd232ed118a4519bca83e3abaa782a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa4d39f-8300-43a9-b5df-7eb510d74076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa4d39f-8300-43a9-b5df-7eb510d74076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b1e65-7c25-4cd8-bfc3-0791cb3689a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b1e65-7c25-4cd8-bfc3-0791cb3689a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0b96a9-c13f-48eb-af7f-09f64c6a0b22', 'volume_name': 'volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a3dce2-5184-4e48-b4c9-75f5db4ed924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a3dce2-5184-4e48-b4c9-75f5db4ed924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecd28a5-7d44-43ed-b236-f4702554b8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:02 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Volume 1e0b96a9-c13f-48eb-af7f-09f64c6a0b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22', 'volume_size': 1} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1052404766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0b96a9-c13f-48eb-af7f-09f64c6a0b22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea219d62383649dfae82cd267054c297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:03Z,use_quota=True,user_id='2cd232ed118a4519bca83e3abaa782a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Creating volume 1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:02 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:28:02 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:02 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 1073741824 Sep 28 17:28:02 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3" returned: 0 in 0.372s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3 Sep 28 17:28:03 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 1073741824" returned: 0 in 0.485s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:03 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102.29fdd726-336f-48c5-918b-786b8f694fa3" returned: 0 in 0.305s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 Sep 28 17:28:03 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-29fdd726-336f-48c5-918b-786b8f694fa3" released by "_delete_snapshot" :: held 1.682s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" released by "delete_snapshot" :: held 1.711s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Created reservations ['3361c1bf-3184-4d2c-aa66-708773aab739', 'ecae1c88-62d7-4dcb-8d47-d3d871fe08be', '08813d8d-24ed-405e-b550-0d348c2a31f0', '8347d443-4d13-4813-a166-5c02ab278adf'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-be3d83a5-6328-4d65-b121-5921b165fa09 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-29fdd726-336f-48c5-918b-786b8f694fa3-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:03 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" returned: 0 in 0.285s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecd28a5-7d44-43ed-b236-f4702554b8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b074ac45-9445-452c-ba02-4954de6601f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:03 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Volume volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 (1e0b96a9-c13f-48eb-af7f-09f64c6a0b22): created successfully Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b074ac45-9445-452c-ba02-4954de6601f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Flow 'volume_create_manager' (c0cf2602-d5a0-4d68-bbbc-c8ef5700c62c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:03 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f554e68e-3bc6-481e-832e-06fe56961bec tempest-ProjectReaderTests-1538372496 None] Created volume successfully. Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-e85f480b-3c71-453b-a848-23b8b0fb7102-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:03 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "cinder-e85f480b-3c71-453b-a848-23b8b0fb7102-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[099de0d5-e5dc-4e34-8265-7f2bea552199]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 Sep 28 17:28:04 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102" returned: 0 in 0.422s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:04 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102 Sep 28 17:28:04 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:04 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-e85f480b-3c71-453b-a848-23b8b0fb7102" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-e85f480b-3c71-453b-a848-23b8b0fb7102" released by "delete_volume" :: held 0.790s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Created reservations ['ffd09255-5768-4e64-a9e5-0cd90ae8d335', '4a349e50-5cec-4dfa-81ad-67b820447fef', 'b651bfba-eb2c-4592-b9fe-a39e6bb9b310', '2c0996c7-1c97-4e64-a69c-ac37dfdc8e94'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:04 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:05 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Acquiring lock "cinder-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "cinder-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Acquiring lock "cinder-quobyte-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "cinder-quobyte-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" acquired by "delete_volume" :: waited 0.023s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[978a5ca5-f973-44f5-9fa5-3b85c9d5a4be]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.322s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:05 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-c2e348e6-e030-450f-a828-f5c559ce0a4b tempest-ProjectMemberTests-1653911807 None] Lock "cinder-e85f480b-3c71-453b-a848-23b8b0fb7102-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:05 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 Sep 28 17:28:05 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" returned: 0 in 0.530s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:05 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22 Sep 28 17:28:05 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (2ace9feb-492f-4348-9851-c82b4cd09722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71596f31-2a87-4646-bada-88dde73143e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71596f31-2a87-4646-bada-88dde73143e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637352693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c2efad-e9e8-495a-9180-ed062dbe2d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d33420-e1fc-485c-b6e5-3c2db9ed5081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d33420-e1fc-485c-b6e5-3c2db9ed5081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37b704e-f43c-4bb4-88e9-fa4eed93d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37b704e-f43c-4bb4-88e9-fa4eed93d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39c2efad-e9e8-495a-9180-ed062dbe2d29', 'volume_name': 'volume-39c2efad-e9e8-495a-9180-ed062dbe2d29', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd85151d-d0d4-40ba-8ed8-1acca166ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd85151d-d0d4-40ba-8ed8-1acca166ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b35982-746b-444f-9161-96be6dad3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:05 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Volume 39c2efad-e9e8-495a-9180-ed062dbe2d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39c2efad-e9e8-495a-9180-ed062dbe2d29', 'volume_size': 1} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637352693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39c2efad-e9e8-495a-9180-ed062dbe2d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:06Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Creating volume 39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:05 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:28:05 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:05 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 1073741824 Sep 28 17:28:05 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "cinder-quobyte-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22" released by "delete_volume" :: held 0.874s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Created reservations ['478ef53e-39d8-46cd-a68e-25ffa75261b1', 'e5dba9ef-bf36-497e-a00b-999549b10764', '9b2f8f84-994d-423e-8b09-a7d1bc05261d', '86aaccc5-bf1d-4656-a53d-c303cd115606'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:06 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 1073741824" returned: 0 in 0.544s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:06 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 Sep 28 17:28:06 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:06 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.287s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Deleted volume successfully. Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-a6ace22f-8c34-45e9-960c-9cc5852130e4 tempest-ProjectReaderTests-1538372496 None] Lock "cinder-1e0b96a9-c13f-48eb-af7f-09f64c6a0b22-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:06 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29" returned: 0 in 0.311s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b35982-746b-444f-9161-96be6dad3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39c2efad-e9e8-495a-9180-ed062dbe2d29', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d6afda-8b05-4b83-9ff0-886e4e6c61e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Volume volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 (39c2efad-e9e8-495a-9180-ed062dbe2d29): created successfully Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d6afda-8b05-4b83-9ff0-886e4e6c61e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (2ace9feb-492f-4348-9851-c82b4cd09722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:06 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-410593d2-50e8-422b-a637-290865c1043c tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Flow 'volume_create_manager' (b89e1a7a-55c7-444f-b3bc-9f34e018173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26be0690-46c2-473b-ae56-e05f26ebca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26be0690-46c2-473b-ae56-e05f26ebca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375040789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac1e3b9-be94-467e-b6ce-7edc41ced5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea219d62383649dfae82cd267054c297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:07Z,use_quota=True,user_id='2cd232ed118a4519bca83e3abaa782a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:06 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63ad2a-d0c1-4208-9e06-f9435f44ed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63ad2a-d0c1-4208-9e06-f9435f44ed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfcdab6-2c98-422c-b4f6-ea767e8349e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbfcdab6-2c98-422c-b4f6-ea767e8349e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac1e3b9-be94-467e-b6ce-7edc41ced5f8', 'volume_name': 'volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3d5eb-fbca-4603-8e7d-aff7efec428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32e3d5eb-fbca-4603-8e7d-aff7efec428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11ea603-d874-44b9-ba6e-1e955a2af662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Volume eac1e3b9-be94-467e-b6ce-7edc41ced5f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8', 'volume_size': 1} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1375040789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac1e3b9-be94-467e-b6ce-7edc41ced5f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea219d62383649dfae82cd267054c297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:07Z,use_quota=True,user_id='2cd232ed118a4519bca83e3abaa782a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Creating volume eac1e3b9-be94-467e-b6ce-7edc41ced5f8 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:07 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 1073741824 Sep 28 17:28:07 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 1073741824" returned: 0 in 0.448s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:07 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 Sep 28 17:28:07 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:07 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" returned: 0 in 0.279s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f11ea603-d874-44b9-ba6e-1e955a2af662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2168e50e-16af-4155-bd24-83c3ea119d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:07 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Volume volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 (eac1e3b9-be94-467e-b6ce-7edc41ced5f8): created successfully Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2168e50e-16af-4155-bd24-83c3ea119d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:07 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Flow 'volume_create_manager' (b89e1a7a-55c7-444f-b3bc-9f34e018173c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:07 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b7073f1b-a895-433f-bec2-1855e11f6d91 tempest-ProjectReaderTests-1538372496 None] Created volume successfully. Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot b16a441b-a68e-4a35-b6ea-2a4642110a1a of volume 39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dd1ddb-99a4-4626-adbf-840bf1fccc89]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 Sep 28 17:28:08 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a 1G Sep 28 17:28:08 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:08 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a 1G" returned: 0 in 0.409s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:08 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:08 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a Sep 28 17:28:08 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Acquiring lock "cinder-eac1e3b9-be94-467e-b6ce-7edc41ced5f8-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "cinder-eac1e3b9-be94-467e-b6ce-7edc41ced5f8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Acquiring lock "cinder-quobyte-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "cinder-quobyte-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" acquired by "delete_volume" :: waited 0.024s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a275f17-44fd-4b49-a396-68f58373aaff]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a is being set with open permissions: ugo+rw Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a Sep 28 17:28:09 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 Sep 28 17:28:09 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a" returned: 0 in 0.257s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info Sep 28 17:28:09 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" returned: 0 in 0.400s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8 Sep 28 17:28:09 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info" returned: 0 in 0.271s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info is being set with open permissions: ugo+rw Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:09 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info Sep 28 17:28:09 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:09 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" returned: 0 in 0.274s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "cinder-quobyte-eac1e3b9-be94-467e-b6ce-7edc41ced5f8" released by "delete_volume" :: held 0.723s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Created reservations ['e8c7971d-ab34-4328-86e1-7e8b6fa804c2', 'c962bd69-12d6-40d7-9aaf-b990eec32200', '039ed2a8-f220-494b-b2ba-b9151e2cab9b', 'b8d0eb52-e71a-4c98-97f1-4033f1e6bdc7'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:09 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.info" returned: 0 in 0.277s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:10 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-271340f5-d47a-4d8c-8969-fe7467f537f1 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-b16a441b-a68e-4a35-b6ea-2a4642110a1a-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-b16a441b-a68e-4a35-b6ea-2a4642110a1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-b16a441b-a68e-4a35-b6ea-2a4642110a1a" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-b16a441b-a68e-4a35-b6ea-2a4642110a1a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:10 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot b16a441b-a68e-4a35-b6ea-2a4642110a1a of volume 39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:10 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Deleted volume successfully. Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[736ce444-f282-46d4-a024-3349dd50ca37]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b3b4a95a-b99b-43c3-8b30-807e18efbf6f tempest-ProjectReaderTests-1538372496 None] Lock "cinder-eac1e3b9-be94-467e-b6ce-7edc41ced5f8-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:10 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a Sep 28 17:28:10 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:10 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a" returned: 0 in 0.416s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39c2efad-e9e8-495a-9180-ed062dbe2d29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fac6ef6-7246-418e-b780-8fc47149aa03]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:10 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:10 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 Sep 28 17:28:10 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29" returned: 0 in 0.408s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a Sep 28 17:28:11 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a" returned: 0 in 0.439s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:11 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a Sep 28 17:28:11 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:11 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:11 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29.b16a441b-a68e-4a35-b6ea-2a4642110a1a" returned: 0 in 0.292s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-b16a441b-a68e-4a35-b6ea-2a4642110a1a" released by "_delete_snapshot" :: held 1.685s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" released by "delete_snapshot" :: held 1.715s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Created reservations ['897f42d9-797a-487a-8922-8c284804c0ff', '402ab265-c720-4827-b8cc-7f77ff7f3061', '56497c95-bd82-4d24-a5e7-59b4f027c5a1', '00d267ff-2874-4ee9-b36f-09dc3c59aaa5'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:12 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-b8c4176f-1420-4140-a541-34ff3fa9ae06 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-b16a441b-a68e-4a35-b6ea-2a4642110a1a-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-39c2efad-e9e8-495a-9180-ed062dbe2d29-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-39c2efad-e9e8-495a-9180-ed062dbe2d29-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" acquired by "delete_volume" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd22b3d6-1d11-4aa9-8073-682273dd2a6a]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:12 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:12 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 Sep 28 17:28:12 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29" returned: 0 in 0.427s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29 Sep 28 17:28:13 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-39c2efad-e9e8-495a-9180-ed062dbe2d29" returned: 0 in 0.290s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-39c2efad-e9e8-495a-9180-ed062dbe2d29" released by "delete_volume" :: held 0.792s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Created reservations ['4d22a51d-b866-4415-bdaa-bdc0f038e217', 'e15c2103-398e-4e2e-b607-342261d3d912', 'e048ec23-e9cf-4de9-b166-525c39babe47', '7e7d16ea-77c6-4d6c-a3ec-23c7af5ac704'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:13 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:13 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:13 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.280s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:13 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:28:13 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-6c546ade-249c-48c5-921b-e1a29d4187a7 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-39c2efad-e9e8-495a-9180-ed062dbe2d29-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (385ca80c-b193-4f1f-80fa-7c73990bda0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c0fe3b-9246-4e07-a425-deede87d2000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c0fe3b-9246-4e07-a425-deede87d2000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672818790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a826cf-9a13-4bb8-b0a2-ccde495485e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:14Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a313f33-fd9c-4620-8295-d9b07d3055d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a313f33-fd9c-4620-8295-d9b07d3055d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e62c5-e760-426e-87d1-3907fcf7de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a4e62c5-e760-426e-87d1-3907fcf7de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a826cf-9a13-4bb8-b0a2-ccde495485e6', 'volume_name': 'volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead9d521-71c6-415a-8f58-65154532348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead9d521-71c6-415a-8f58-65154532348e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18764a0-9c76-49c5-a4fb-ac344449ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:14 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Volume 02a826cf-9a13-4bb8-b0a2-ccde495485e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6', 'volume_size': 1} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-672818790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a826cf-9a13-4bb8-b0a2-ccde495485e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:14Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Creating volume 02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:14 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 1073741824 Sep 28 17:28:14 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:14 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 1073741824" returned: 0 in 0.493s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:14 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:14 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 Sep 28 17:28:14 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:15 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6" returned: 0 in 0.275s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c18764a0-9c76-49c5-a4fb-ac344449ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ede769-a7b4-43c1-944e-7d536bd502bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:15 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Volume volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 (02a826cf-9a13-4bb8-b0a2-ccde495485e6): created successfully Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ede769-a7b4-43c1-944e-7d536bd502bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:15 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (385ca80c-b193-4f1f-80fa-7c73990bda0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:15 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-2eda6dcf-7d55-436d-b44c-12fca3fd76b8 tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 37f6523f-9cb3-41c8-874a-63d0d9ebfcba of volume 02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7935d-c5e2-4ca4-9ff1-93b32a229073]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 Sep 28 17:28:16 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:16 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6" returned: 0 in 0.382s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:16 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba 1G Sep 28 17:28:16 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba 1G" returned: 0 in 0.430s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba Sep 28 17:28:17 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba is being set with open permissions: ugo+rw Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba Sep 28 17:28:17 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:17 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba" returned: 0 in 0.252s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:17 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info Sep 28 17:28:17 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:18 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info" returned: 0 in 0.240s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:18 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info is being set with open permissions: ugo+rw Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:18 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info Sep 28 17:28:18 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:18 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.info" returned: 0 in 0.236s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:18 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-f8806953-8823-46e9-a906-fbf3cb0e1f44 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-37f6523f-9cb3-41c8-874a-63d0d9ebfcba-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-37f6523f-9cb3-41c8-874a-63d0d9ebfcba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-37f6523f-9cb3-41c8-874a-63d0d9ebfcba" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-37f6523f-9cb3-41c8-874a-63d0d9ebfcba" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 37f6523f-9cb3-41c8-874a-63d0d9ebfcba of volume 02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5d51fe-e71a-4087-b9c2-bb74deeebb52]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:18 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba Sep 28 17:28:18 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba" returned: 0 in 0.370s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3a3ba4-c77a-455d-be1d-28dd46453366]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 Sep 28 17:28:19 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6" returned: 0 in 0.372s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba Sep 28 17:28:19 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba" returned: 0 in 0.320s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:19 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba Sep 28 17:28:19 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:19 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6.37f6523f-9cb3-41c8-874a-63d0d9ebfcba" returned: 0 in 0.240s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-37f6523f-9cb3-41c8-874a-63d0d9ebfcba" released by "_delete_snapshot" :: held 1.394s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" released by "delete_snapshot" :: held 1.415s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Created reservations ['4aa6b05e-69fd-4082-b006-9b3ad32fbe76', '28c4cd99-81ea-491f-a8ca-c34ec9a59778', '75bdbb60-b613-44b5-832a-ef9b2421f8c8', 'fa022771-6454-4135-a2af-d979514209de'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-8d6e363f-dc44-42aa-9c8f-dbbae3651125 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-37f6523f-9cb3-41c8-874a-63d0d9ebfcba-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-02a826cf-9a13-4bb8-b0a2-ccde495485e6-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-02a826cf-9a13-4bb8-b0a2-ccde495485e6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdbce03-42bb-40ed-b605-7800db42aae6]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:20 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 Sep 28 17:28:20 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6" returned: 0 in 0.377s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6 Sep 28 17:28:21 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-02a826cf-9a13-4bb8-b0a2-ccde495485e6" returned: 0 in 0.283s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-02a826cf-9a13-4bb8-b0a2-ccde495485e6" released by "delete_volume" :: held 0.726s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Created reservations ['d04a14ad-492e-4cce-b324-6cd10ba6d1a2', 'a9303562-941f-4d77-adb5-afacaa8a1e8f', '087ce9a1-6114-49ba-8f65-f74e457a309a', '745f8342-384f-46d9-bba6-cca2b6d7e342'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:21 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:21 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:21 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.255s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:21 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:28:21 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-320fac4f-82c6-49a3-9006-e1f739909077 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-02a826cf-9a13-4bb8-b0a2-ccde495485e6-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (90021466-17c7-4f8d-ac8b-009fc4134fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fd9294-8df8-44b8-8cdf-4b88428b5580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3fd9294-8df8-44b8-8cdf-4b88428b5580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692165873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1b62e8-bef9-4d13-afc9-b959c6ffa712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:22Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a179ab-58f4-4aff-b147-1e210f92623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a179ab-58f4-4aff-b147-1e210f92623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9fccbd-8aea-4d9e-a2a7-0858f4a45864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b9fccbd-8aea-4d9e-a2a7-0858f4a45864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a1b62e8-bef9-4d13-afc9-b959c6ffa712', 'volume_name': 'volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56428d55-30c3-4fb2-aef6-2879ae863a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56428d55-30c3-4fb2-aef6-2879ae863a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8440679-009f-4a72-bedc-b65d1e14d16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:22 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Volume 0a1b62e8-bef9-4d13-afc9-b959c6ffa712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712', 'volume_size': 1} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692165873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1b62e8-bef9-4d13-afc9-b959c6ffa712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b01c150588884f34a43ed5939dc618b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:28:22Z,use_quota=True,user_id='e7bbae6526534437813ab73674a2440f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Creating volume 0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:28:22 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 1073741824 Sep 28 17:28:22 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:22 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 1073741824" returned: 0 in 0.412s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:22 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:22 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 Sep 28 17:28:22 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" returned: 0 in 0.261s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8440679-009f-4a72-bedc-b65d1e14d16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e7ca8b-d404-4e04-b260-039885bfaf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:28:23 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Volume volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 (0a1b62e8-bef9-4d13-afc9-b959c6ffa712): created successfully Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e7ca8b-d404-4e04-b260-039885bfaf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Flow 'volume_create_manager' (90021466-17c7-4f8d-ac8b-009fc4134fa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:28:23 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-faddf389-0464-465d-8ae3-e2036cf825f2 tempest-ProjectMemberTests-1653911807 None] Created volume successfully. Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Creating offline snapshot 2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 of volume 0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0adf11-f63a-42bb-9043-af3127a3678d]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:23 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 Sep 28 17:28:23 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:23 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" returned: 0 in 0.384s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:23 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 1G Sep 28 17:28:24 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 1G" returned: 0 in 0.463s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 Sep 28 17:28:24 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:24 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" returned: 0 in 0.315s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:24 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 is being set with open permissions: ugo+rw Sep 28 17:28:24 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:24 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 Sep 28 17:28:24 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" returned: 0 in 0.294s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info Sep 28 17:28:25 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info" returned: 0 in 0.289s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info is being set with open permissions: ugo+rw Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:25 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info Sep 28 17:28:25 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:25 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.info" returned: 0 in 0.284s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:25 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:25 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-a27a2753-1c36-46ce-9b27-201b638ff7c3 tempest-ProjectMemberTests-1653911807 None] Create snapshot completed successfully Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Deleting offline snapshot 2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 of volume 0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] snapshot_file for this snap is: volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ba1746-021e-4493-819b-7ba0c20ea105]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:26 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 Sep 28 17:28:27 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:27 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" returned: 0 in 0.387s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[b984953e-7c35-4c3a-9c31-1254b16f2c67]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 Sep 28 17:28:27 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:27 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" returned: 0 in 0.358s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:27 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 Sep 28 17:28:27 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:28 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" returned: 0 in 0.339s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:28 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7 Sep 28 17:28:28 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:28 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712.2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" returned: 0 in 0.267s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7" released by "_delete_snapshot" :: held 1.450s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" released by "delete_snapshot" :: held 1.472s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Created reservations ['25bb3486-55ad-484f-bd26-791aba98741c', '98e7305a-b2e4-4372-a7bf-f5328be012b7', '893f0e26-3019-4b6c-86db-179cf1b126b8', '2e40aee4-120b-499a-a432-297512bc2b97'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:28 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Delete snapshot completed successfully. Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-617318f5-f6b3-449b-ac98-d3da98ce08e9 tempest-ProjectMemberTests-1653911807 None] Lock "cinder-2ddf444d-fd1f-4de6-b9b8-bf2d4e7e29d7-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-0a1b62e8-bef9-4d13-afc9-b959c6ffa712-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-0a1b62e8-bef9-4d13-afc9-b959c6ffa712-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" acquired by "delete_volume" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3815a86f-e399-479c-b6f6-b7ea31586639]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:29 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 Sep 28 17:28:29 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:29 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" returned: 0 in 0.394s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:29 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712 Sep 28 17:28:29 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:29 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" returned: 0 in 0.262s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-quobyte-0a1b62e8-bef9-4d13-afc9-b959c6ffa712" released by "delete_volume" :: held 0.714s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Created reservations ['4ce4946c-c098-455d-b752-3f78330a6edc', 'b7d4ae34-a9b4-462b-9d89-fea3b46d879d', '3daebc66-bf8b-4ba4-92ad-ff610b6ca7f4', '42f70a6f-739e-4f70-9a39-83b5ca01b7ac'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:29 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:29 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:30 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.257s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:30 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Deleted volume successfully. Sep 28 17:28:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-dec586a8-281f-40a8-8813-bc47d2e2145e tempest-ProjectMemberTests-1653911807 None] Lock "cinder-0a1b62e8-bef9-4d13-afc9-b959c6ffa712-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:28:39 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=80,cinder:INSERT=28,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=114,cinder:DELETE=10,cinder:SELECT=77,cinder:INSERT=30 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:28:44 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:28:44 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:28:44 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.266s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:28:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Flow 'volume_create_manager' (8f7a5db5-7fa0-4b19-bd41-91dcbe188fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e86c6-f39d-415a-a4fd-8a696e8ba6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d86e86c6-f39d-415a-a4fd-8a696e8ba6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-693864408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50900da-7fde-42b2-93ad-a1b19160b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec8261e14564579a326daa19e564ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:17Z,use_quota=True,user_id='ea2c4b65ef224a53b5434874df928966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd8f2ed-0c39-4d5e-80c2-c40248662c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cd8f2ed-0c39-4d5e-80c2-c40248662c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705deef4-4d3c-4f37-8e69-7077c8d10046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (705deef4-4d3c-4f37-8e69-7077c8d10046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50900da-7fde-42b2-93ad-a1b19160b5b7', 'volume_name': 'volume-f50900da-7fde-42b2-93ad-a1b19160b5b7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40053c2-a1f7-43df-9cdb-287e47808f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40053c2-a1f7-43df-9cdb-287e47808f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f638-de2c-4450-a4fd-46079ddee847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:16 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Volume f50900da-7fde-42b2-93ad-a1b19160b5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50900da-7fde-42b2-93ad-a1b19160b5b7', 'volume_size': 1} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-693864408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50900da-7fde-42b2-93ad-a1b19160b5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec8261e14564579a326daa19e564ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:17Z,use_quota=True,user_id='ea2c4b65ef224a53b5434874df928966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)}" {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Creating volume f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:16 devstack cinder-volume[86842]: INFO cinder.volume.drivers.remotefs [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] casted to osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 Sep 28 17:29:16 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 1073741824 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:16 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 1073741824 Sep 28 17:29:16 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:17 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 1073741824" returned: 0 in 0.440s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:17 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:17 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:17 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.245s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'} {{(pid=86842) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd2f638-de2c-4450-a4fd-46079ddee847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50900da-7fde-42b2-93ad-a1b19160b5b7', 'volume_size': 1}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e646a2-dabd-4c88-b486-05ea7712b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:17 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Volume volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 (f50900da-7fde-42b2-93ad-a1b19160b5b7): created successfully Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e646a2-dabd-4c88-b486-05ea7712b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:17 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Flow 'volume_create_manager' (8f7a5db5-7fa0-4b19-bd41-91dcbe188fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:17 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-562cd148-cc44-40c6-a276-f10481cf843b tempest-SnapshotDependencyTests-804675883 None] Created volume successfully. Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Creating offline snapshot 2cebb7b5-2ee8-417e-a0e3-89c612545c79 of volume f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2e3b19-6b34-4a1c-88bc-d1672f956519]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:18 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.369s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 1G {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 1G Sep 28 17:29:18 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:18 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 1G" returned: 0 in 0.419s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:18 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:18 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:18 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 -F qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.299s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 is being set with open permissions: ugo+rw Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:19 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.254s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info Sep 28 17:29:19 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info" returned: 0 in 0.272s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:19 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info is being set with open permissions: ugo+rw Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:19 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info Sep 28 17:29:19 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:19 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:19 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.info" returned: 0 in 0.243s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-323e2cfa-53ef-4368-80c8-2860fb388f93 tempest-SnapshotDependencyTests-804675883 None] Create snapshot completed successfully Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.flows.manager.create_volume [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86842) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Flow 'volume_create_manager' (d36343a9-6ae3-46b9-8541-e6aed633d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00024d60-dd11-4130-bad7-c877fca42fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00024d60-dd11-4130-bad7-c877fca42fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T15:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98934737-6223-4a81-afaf-0b2c0c0bcb48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec8261e14564579a326daa19e564ff2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T15:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2cebb7b5-2ee8-417e-a0e3-89c612545c79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T15:29:21Z,use_quota=True,user_id='ea2c4b65ef224a53b5434874df928966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fdd343e-cdca-4c7c-96df-fcb82f227116),volume_type_id=4fdd343e-cdca-4c7c-96df-fcb82f227116)' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9f9c13-808e-4f67-a6d7-8a8a726ef075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9f9c13-808e-4f67-a6d7-8a8a726ef075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c015004-668d-42ad-a9e4-60ce8105b238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c015004-668d-42ad-a9e4-60ce8105b238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '98934737-6223-4a81-afaf-0b2c0c0bcb48', 'volume_name': 'volume-98934737-6223-4a81-afaf-0b2c0c0bcb48', 'volume_size': 1, 'snapshot_id': '2cebb7b5-2ee8-417e-a0e3-89c612545c79'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02898c28-a70e-4dfb-a927-cf0491696634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02898c28-a70e-4dfb-a927-cf0491696634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a83daca-0bbd-4da9-b3df-470ca7e9670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:20 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Volume 98934737-6223-4a81-afaf-0b2c0c0bcb48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-98934737-6223-4a81-afaf-0b2c0c0bcb48', 'volume_size': 1, 'snapshot_id': '2cebb7b5-2ee8-417e-a0e3-89c612545c79'} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79-98934737-6223-4a81-afaf-0b2c0c0bcb48" by "_create_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79-98934737-6223-4a81-afaf-0b2c0c0bcb48" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Creating volume 98934737-6223-4a81-afaf-0b2c0c0bcb48 from snapshot 2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Selected osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4 as target Quobyte volume. {{(pid=86842) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" by "_copy_volume_from_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] snapshot: 2cebb7b5-2ee8-417e-a0e3-89c612545c79, volume: 98934737-6223-4a81-afaf-0b2c0c0bcb48, {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[514245d5-1aea-453c-9071-7964eb4a1dca]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:20 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:21 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.402s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50900da-7fde-42b2-93ad-a1b19160b5b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[645c14c2-3e85-443f-bb1a-8ca06d37e579]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:21 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:21 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.372s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] will copy from snapshot at /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Creating direct copy from snapshot {{(pid=86842) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG cinder.utils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Path /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 not found in is_blk_device check {{(pid=86842) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 17:29:21 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:21 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 Sep 28 17:29:21 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48" returned: 0 in 5.772s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.image.image_utils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Image conversion details: src /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 {{(pid=86842) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 17:29:27 devstack cinder-volume[86842]: INFO cinder.image.image_utils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Converted 1024.00 MB image at 177.38 MB/s Sep 28 17:29:27 devstack cinder-volume[86842]: WARNING cinder.volume.drivers.remotefs [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 is being set with open permissions: ugo+rw Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:27 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 Sep 28 17:29:27 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:27 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48" returned: 0 in 0.240s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" released by "_copy_volume_from_snapshot" :: held 6.865s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79-98934737-6223-4a81-afaf-0b2c0c0bcb48" released by "_create_volume_from_snapshot" :: held 6.926s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.939s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a83daca-0bbd-4da9-b3df-470ca7e9670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98934737-6223-4a81-afaf-0b2c0c0bcb48', 'volume_size': 1, 'snapshot_id': '2cebb7b5-2ee8-417e-a0e3-89c612545c79'}' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8225d430-9b45-4ae9-a730-25a0a2bdeac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 17:29:27 devstack cinder-volume[86842]: INFO cinder.volume.flows.manager.create_volume [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Volume volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 (98934737-6223-4a81-afaf-0b2c0c0bcb48): created successfully Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8225d430-9b45-4ae9-a730-25a0a2bdeac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86842) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 17:29:27 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Flow 'volume_create_manager' (d36343a9-6ae3-46b9-8541-e6aed633d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86842) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 17:29:27 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-07a577f8-5976-4fb6-a7e2-37117d212b71 tempest-SnapshotDependencyTests-804675883 None] Created volume successfully. Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-2cebb7b5-2ee8-417e-a0e3-89c612545c79-delete_snapshot" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-2cebb7b5-2ee8-417e-a0e3-89c612545c79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" by "delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79" by "_delete_snapshot" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Deleting offline snapshot 2cebb7b5-2ee8-417e-a0e3-89c612545c79 of volume f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] snapshot_file for this snap is: volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[71abe857-a725-4d95-9f5b-3b4f3d411d0b]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:28 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:28 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:28 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.373s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.remotefs [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f50900da-7fde-42b2-93ad-a1b19160b5b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86842) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[464941b8-c681-4965-80b2-af219c5a441f]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:28 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:29 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.522s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:29 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:29 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.338s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:29 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:29 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79 Sep 28 17:29:29 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:30 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7.2cebb7b5-2ee8-417e-a0e3-89c612545c79" returned: 0 in 0.260s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-2cebb7b5-2ee8-417e-a0e3-89c612545c79" released by "_delete_snapshot" :: held 1.597s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" released by "delete_snapshot" :: held 1.618s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Created reservations ['e6b4b4ad-398f-44ca-953a-3065fc0af3a6', '04481a29-4fdf-495d-9042-51d923b98db5', '1b6f93c8-0448-48de-9bbe-4c1c70eb02a5', 'a8b1a61f-24a8-4d11-97fc-bb369e78020d'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:30 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Delete snapshot completed successfully. Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-de0db9bc-9107-4a79-b548-7e8a8390b836 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-2cebb7b5-2ee8-417e-a0e3-89c612545c79-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-f50900da-7fde-42b2-93ad-a1b19160b5b7-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-f50900da-7fde-42b2-93ad-a1b19160b5b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" acquired by "delete_volume" :: waited 0.015s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb9caec-d573-415c-b161-bd9c91a611da]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:30 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:30 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:30 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.383s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7 Sep 28 17:29:31 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-f50900da-7fde-42b2-93ad-a1b19160b5b7" returned: 0 in 0.261s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-f50900da-7fde-42b2-93ad-a1b19160b5b7" released by "delete_volume" :: held 0.707s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Created reservations ['9ba13a0f-e869-4996-8ab7-2208deff471b', 'f2ef8324-bb4c-4e92-8202-ce5ded3f6fa0', 'c88b30fd-0f6d-42e6-8ee4-5ec0d5180689', '9f0d6992-2f86-47cf-8f16-5bf1658af331'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:29:31 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:31 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-98934737-6223-4a81-afaf-0b2c0c0bcb48-delete_volume" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.283s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:31 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Deleted volume successfully. Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-98934737-6223-4a81-afaf-0b2c0c0bcb48-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-4a8ec7de-b4b9-4854-acc1-d9eccf7ee2ce tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-f50900da-7fde-42b2-93ad-a1b19160b5b7-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" by "delete_volume" {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" acquired by "delete_volume" :: waited 0.017s {{(pid=86842) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad9525d-dbb2-4b93-b016-8a5415379880]: (4, 'qcow2') {{(pid=87680) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 17:29:31 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:31 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 Sep 28 17:29:31 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48" returned: 0 in 0.364s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48 Sep 28 17:29:32 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212/volume-98934737-6223-4a81-afaf-0b2c0c0bcb48" returned: 0 in 0.261s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-quobyte-98934737-6223-4a81-afaf-0b2c0c0bcb48" released by "delete_volume" :: held 0.668s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.quota [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Created reservations ['0231174c-0d7b-46c5-8c4e-38cdb82f67cc', '8a0f0ac5-3ef2-4158-99b1-443e739d6e85', '054b9189-3ce4-4e10-80d1-d2c2556a5078', '3173e896-3c00-4770-9576-2e5e77e6101c'] {{(pid=86842) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:32 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:29:32 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:32 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.301s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:32 devstack cinder-volume[86842]: INFO cinder.volume.manager [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Deleted volume successfully. Sep 28 17:29:32 devstack cinder-volume[86842]: DEBUG cinder.coordination [None req-d272379d-4c08-40d6-a552-4d35aea1d148 tempest-SnapshotDependencyTests-804675883 None] Lock "cinder-98934737-6223-4a81-afaf-0b2c0c0bcb48-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86842) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 17:29:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:UPDATE=26,cinder:INSERT=7,cinder:SELECT=30,cinder:DELETE=1 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:42 devstack cinder-volume[86842]: DEBUG dbcounter [-] [86842] Writing DB stats cinder:SELECT=19,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=8 {{(pid=86842) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4': None} {{(pid=86842) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG cinder.volume.drivers.quobyte [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f85ff8cb-60d4-4406-a9a0-58dbabb9d3d4'] {{(pid=86842) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.lockutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86842) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 17:29:44 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212 Sep 28 17:29:44 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 17:29:44 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_concurrency.processutils [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/28d0985b8a6f3da0944452315527b212" returned: 0 in 0.265s {{(pid=86842) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG cinder.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Notifying Schedulers of capabilities ... {{(pid=86842) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG oslo_service.periodic_task [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] Running periodic task VolumeManager._thread_info {{(pid=86842) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread count: 28 {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 17:29:44 devstack cinder-volume[86842]: DEBUG cinder.volume.manager [None req-41724b00-5188-494b-98ae-527b8fcd50c6 None None] thread info: [<_MainThread(MainThread, started 126024127266944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86842) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}